00000001:02000400:1.0F:1789023401.828666:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789023420.209675:0:3188:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1789023421.888909:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 587 MB/s 00000001:01000000:2.0:1789023422.141326:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 694 MB/s 00000001:01000000:0.0:1789023422.390560:0:3248:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6859 MB/s 00000020:02000000:1.0:1789023422.859029:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_gf941a14 00000400:02000000:0.0:1789023423.641446:0:3294:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.148@tcp [8/256/0/180] 00008000:02000000:0.0:1789023426.905176:0:3444:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789023478.545320:0:5245:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789023489.196913:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789023489.196918:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789023489.197062:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009b55eb97 00000080:02000400:1.0:1789023489.197074:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' or install '{/usr}/sbin/mount.lustre_tgt' 00000020:01000004:1.0:1789023489.206629:0:5825:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1789023489.206645:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789023489.206789:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f5925510) 00000020:00000080:0.0:1789023489.206813:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789023489.235129:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789023489.236132:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0F:1789023489.268320:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789023489.268378:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789023489.268402:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789023489.268457:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789023489.268519:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789023489.268902:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789023489.268911:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789023489.268922:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb34178f3 00000020:01000004:3.0:1789023489.270817:0:5825:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789023489.270830:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789023489.270843:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b55eb97 from MGS 00000020:01000004:3.0:1789023489.270849:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789023489.270883:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000d2eed627) 00000020:00000080:3.0:1789023489.270903:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789023489.271010:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b55eb97 from MGS, refs=2 00080000:01000000:3.0:1789023489.271018:0:5825:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789023489.271024:0:5825:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3417901 00000100:00100000:3.0:1789023489.271155:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789023489.271951:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789023489.272065:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789023489.273106:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789023489.273116:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789023489.274897:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023489.275444:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789023489.275452:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789023489.276936:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789023489.276948:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789023489.277889:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789023489.277898:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789023489.279306:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023489.279311:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023489.279313:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023489.280078:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023489.280081:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023489.280083:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023489.280905:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789023489.284717:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789023489.530661:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2351 MB/s 00000001:01000000:0.0:1789023489.782753:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2468 MB/s 00000001:01000000:2.0:1789023490.033627:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 500 MB/s 00000001:01000000:2.0:1789023490.283682:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 811 MB/s 00080000:10000000:2.0:1789023490.291044:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789023490.304809:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789023490.304825:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789023490.304828:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1789023490.307670:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789023490.307757:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789023490.307825:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789023490.308085:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789023490.308112:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789023490.309051:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023490.309345:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789023490.309352:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789023490.310329:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789023490.310339:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789023490.310791:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789023490.310797:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1789023490.311595:0:5841:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789023490.311673:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789023490.311762:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.148@tcp' 00000020:01000004:1.0:1789023490.311765:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789023490.311845:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.148@tcp (typ=mgc) 00000020:00000080:1.0:1789023490.311864:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.148@tcp (00000000077c9f6d) 00000020:00000080:1.0:1789023490.311882:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789023490.312022:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000211cb37f@MGC192.168.203.148@tcp: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789023490.312198:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.148@tcp-0 is initialized 00000040:01000000:1.0:1789023490.312204:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 1 is initialized 00010000:00010000:2.0:1789023490.315294:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789023490.315327:0:5843:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789023490.315377:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.148@tcp (uuid 72bd38e6-1e7e-4158-85a3-542824dd2807) 00000020:00000080:2.0:1789023490.315417:0:5825:0:(genops.c:1384:class_connect()) connect: client 72bd38e6-1e7e-4158-85a3-542824dd2807, cookie 0xc3c1fcbfb341790f 00000100:00080000:2.0:1789023490.315436:0:5825:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789023490.315447:0:5825:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import 00000000211cb37f using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789023490.315517:0:5825:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000777126d9 x1875927024795776/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789023490.315536:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS 00000020:01000004:2.0:1789023490.315551:0:5825:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789023490.315556:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789023490.315576:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000001a00287c) 00000020:00000080:2.0:1789023490.315588:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1789023490.319331:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000777126d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72bd38e6-1e7e-4158-85a3-542824dd2807:3309:1875927024795776:0@lo:250: 00000100:00100000:3.0:1789023490.319416:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023490.319506:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024795776 00000100:00100000:3.0:1789023490.319515:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024795776 00000100:00100000:3.0:1789023490.319546:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023490.319553:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be9711ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875927024795776:12345-0@lo:250: 00010000:00080000:3.0:1789023490.319579:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 72bd38e6-1e7e-4158-85a3-542824dd2807@0@lo t0 exp 0000000000000000 cur 156 last 0 00000020:00000080:3.0:1789023490.319617:0:5838:0:(genops.c:1384:class_connect()) connect: client 72bd38e6-1e7e-4158-85a3-542824dd2807, cookie 0xc3c1fcbfb341791d 00000100:00080000:3.0:1789023490.319802:0:5838:0:(import.c:65:import_set_state_nolock()) 00000000c0ef9bfc : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023490.319865:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be9711ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+5:3309:x1875927024795776:12345-0@lo:250: Request processed in 311us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023490.319872:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023490.319920:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1789023490.319937:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.148@tcp: connect to target with instance 0 00000100:00080000:3.0:1789023490.319945:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1789023490.319951:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1789023490.319953:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000211cb37f MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1789023490.319956:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1789023490.319963:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1789023490.319968:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000777126d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72bd38e6-1e7e-4158-85a3-542824dd2807:3309:1875927024795776:0@lo:250: 00000100:00100000:2.0:1789023490.339594:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023490.339797:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789023490.339804:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789023490.341309:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789023490.341318:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789023490.342074:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789023490.342083:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789023490.344451:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023490.344720:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789023490.344727:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789023490.345686:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789023490.345713:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789023490.389602:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023490.389823:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789023490.389842:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789023490.391320:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789023490.391333:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789023490.392295:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023490.392619:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789023490.392625:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789023490.393329:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789023490.393338:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789023490.396452:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023490.396683:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789023490.396690:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789023490.397455:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789023490.397464:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789023490.398323:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023490.398536:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789023490.398542:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789023490.399174:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789023490.399182:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789023490.437267:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023490.437737:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789023490.437744:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789023490.440949:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789023490.441139:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789023490.442591:0:5825:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789023490.442769:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789023490.445369:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789023490.445393:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789023490.445399:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789023490.445779:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789023490.445814:0:5825:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789023490.445819:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789023490.445821:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023490.445822:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023490.445823:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023490.445824:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023490.445825:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023490.445826:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023490.445827:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023490.445828:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023490.445829:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023490.445831:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023490.445832:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789023490.445834:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789023490.445836:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789023490.445837:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023490.445838:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023490.445839:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023490.445840:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023490.445841:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023490.445842:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023490.445843:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023490.445844:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023490.445845:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023490.445846:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023490.445847:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789023490.445873:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789023490.445895:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba697191 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024795904:0@lo:253: 00000100:00100000:2.0:1789023490.446115:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023490.446211:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000007e1a5190 going to sleep for 11 seconds 00000100:00100000:1.0:1789023490.446304:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024795904 00000100:00100000:1.0:1789023490.446312:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024795904 00000100:00100000:1.0:1789023490.446397:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023490.446406:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000055c98897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+5:5825:x1875927024795904:12345-0@lo:253: 20000000:01000000:1.0:1789023490.446453:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789023490.446456:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789023490.447016:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789023490.447136:0:5840:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789023490.447474:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023490.449440:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1789023490.450155:0:5840:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789023490.450160:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1789023490.450165:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1789023490.450168:0:5840:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1789023490.450185:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1789023490.450449:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023490.451220:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1789023490.451237:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789023490.451282:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1789023490.451327:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1789023490.451361:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1789023490.451448:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1789023490.451455:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1789023490.451755:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1789023490.451765:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1789023490.451815:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1789023490.451824:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1789023490.451856:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1789023490.451905:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1789023490.452074:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789023490.452081:0:5840:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1789023490.452097:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023490.452309:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1789023490.452320:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789023490.452354:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1789023490.452389:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1789023490.452436:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1789023490.452448:0:5840:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1789023490.452809:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1789023490.452827:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1789023490.452876:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1789023490.452915:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1789023490.453589:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1789023490.453871:0:5840:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1789023490.454171:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1789023490.454183:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1789023490.454221:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1789023490.454257:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1789023490.454878:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1789023490.455097:0:5840:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789023490.455105:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1789023490.455838:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789023490.456269:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789023490.456294:0:5840:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.148@tcp for mdt 20000000:01000000:1.0:1789023490.456297:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:1.0:1789023490.456334:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789023490.456342:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789023490.456792:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789023490.456809:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:1.0:1789023490.456900:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789023490.456918:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789023490.457201:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789023490.457282:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789023490.458140:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789023490.458147:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789023490.458154:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789023490.458177:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789023490.458182:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789023490.458240:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789023490.458244:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789023490.460359:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789023490.461138:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789023490.461193:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789023490.461269:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1789023490.461283:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789023490.461286:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789023490.461978:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789023490.462212:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789023490.462252:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789023490.462290:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1789023490.462305:0:5840:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023490.462307:0:5840:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1789023490.462312:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789023490.462314:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789023490.462327:0:5840:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789023490.462333:0:5840:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789023490.463027:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789023490.463132:0:5840:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789023490.478220:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789023490.478315:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789023490.478430:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789023490.478464:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789023490.478554:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478576:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478588:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478595:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478661:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478670:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478678:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008cd09a2b already unused, calling callback (0000000030c87fcd) 00010000:00010000:0.0:1789023490.478682:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478690:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478702:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478711:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.478717:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008cd09a2b/0xc3c1fcbfb3417924 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789023490.478734:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789023490.827133:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000055c98897 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+5:5825:x1875927024795904:12345-0@lo:253: Request processed in 380721us (381011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023490.827147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023490.827230:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba697191 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024795904:0@lo:253: 10000000:01000000:2.0:1789023490.827245:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789023490.827247:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789023490.827249:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023490.827250:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023490.827251:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789023490.827252:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023490.827253:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023490.827254:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023490.827255:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023490.827256:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789023490.827257:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023490.827258:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789023490.827277:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009b55eb97 from lustre-MDT0000 10000000:01000000:2.0:1789023490.827299:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789023490.827301:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789023490.827305:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e65d2720000 10000000:01000000:2.0:1789023490.827309:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789023490.827315:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e65d2720000 from 1 10000000:01000000:2.0:1789023490.827318:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789023490.827353:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.827369:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.827379:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023490.827396:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba697191 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796032:0@lo:101: 00000100:00100000:2.0:1789023490.827429:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023490.827600:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000008085bc33 going to sleep for 11 seconds 00000100:00100000:3.0:1789023490.828012:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796032 00000100:00100000:3.0:1789023490.828021:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796032 00000100:00100000:3.0:1789023490.828136:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789023490.828148:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007299b24f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+5:5825:x1875927024796032:12345-0@lo:101: 00010000:00010000:3.0:1789023490.828164:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023490.828186:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb341792b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023490.828215:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023490.828227:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023490.828237:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f99fa5a8, rc 0) 00000100:00100000:3.0:1789023490.828311:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007299b24f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+6:5825:x1875927024796032:12345-0@lo:101: Request processed in 164us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023490.828319:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023490.828408:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba697191 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796032:0@lo:101: 00010000:00010000:2.0:1789023490.828420:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.828427:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023490.828502:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba697191 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796160:0@lo:501: 00000100:00100000:2.0:1789023490.828531:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023490.829067:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000008085bc33 going to sleep for 11 seconds 00000100:00100000:0.0:1789023490.829119:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796160 00000100:00100000:0.0:1789023490.829127:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796160 00000100:00100000:1.0:1789023490.829356:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023490.829366:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003587ac20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+6:5825:x1875927024796160:12345-0@lo:501: 00000100:00100000:1.0:1789023490.830086:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003587ac20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+6:5825:x1875927024796160:12345-0@lo:501: Request processed in 719us (1552us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789023490.830095:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023490.830259:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba697191 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796160:0@lo:501: 10000000:01000000:0.0:1789023490.830304:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789023490.830380:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.830401:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023490.830409:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e65d252c800 10000000:01000000:0.0:1789023490.830414:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789023490.830418:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e65d252c800 10000000:01000000:0.0:1789023490.830420:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789023490.830423:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e65d252c800 from 1 10000000:01000000:0.0:1789023490.830425:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789023490.830465:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 000000008cd09a2b/0xc3c1fcbfb3417939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.830474:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 000000008cd09a2b/0xc3c1fcbfb3417939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.830565:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 000000008cd09a2b/0xc3c1fcbfb3417939 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023490.830582:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796288:0@lo:101: 00000100:00100000:0.0:1789023490.830784:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023490.830823:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004f547 going to sleep for 11 seconds 00000100:00100000:2.0:1789023490.830965:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796288 00000100:00100000:2.0:1789023490.830971:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796288 00000100:00100000:2.0:1789023490.831012:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023490.831020:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002f4184d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+6:5825:x1875927024796288:12345-0@lo:101: 00010000:00010000:2.0:1789023490.831031:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023490.831046:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084108995/0xc3c1fcbfb3417940 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417939 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.831068:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084108995/0xc3c1fcbfb3417940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417939 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.831084:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084108995/0xc3c1fcbfb3417940 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417939 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.831092:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084108995, rc 0) 00000100:00100000:2.0:1789023490.831121:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002f4184d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+7:5825:x1875927024796288:12345-0@lo:101: Request processed in 103us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023490.831127:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789023490.831204:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796288:0@lo:101: 00010000:00010000:0.0:1789023490.831216:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 000000008cd09a2b/0xc3c1fcbfb3417939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.831223:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 000000008cd09a2b/0xc3c1fcbfb3417939 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023490.831246:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789023490.832425:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 000000008cd09a2b/0xc3c1fcbfb3417939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.832439:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 000000008cd09a2b/0xc3c1fcbfb3417939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023490.832447:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789023490.832452:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789023490.832458:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e65d252c800 10000000:01000000:0.0:1789023490.832461:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789023490.832464:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789023490.832466:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789023490.832742:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.832750:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.832757:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023490.832775:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796416:0@lo:101: 00000100:00100000:0.0:1789023490.832823:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023490.832972:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004f547 going to sleep for 11 seconds 00000100:00100000:2.0:1789023490.833096:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796416 00000100:00100000:2.0:1789023490.833105:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796416 00000100:00100000:2.0:1789023490.833220:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023490.833232:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000865b8e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+7:5825:x1875927024796416:12345-0@lo:101: 00010000:00010000:2.0:1789023490.833250:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023490.833265:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417947 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.833294:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.833307:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023490.833316:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eff1acc1, rc 0) 00000100:00100000:2.0:1789023490.833372:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000865b8e21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+8:5825:x1875927024796416:12345-0@lo:101: Request processed in 143us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023490.833380:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023490.833547:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796416:0@lo:101: 00010000:00010000:0.0:1789023490.833567:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023490.833602:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023490.833723:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796544:0@lo:501: 00000100:00100000:0.0:1789023490.833768:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023490.834124:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004f547 going to sleep for 11 seconds 00000100:00100000:1.0:1789023490.834211:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796544 00000100:00100000:1.0:1789023490.834218:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796544 00000100:00100000:1.0:1789023490.834245:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023490.834251:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000033370a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+8:5825:x1875927024796544:12345-0@lo:501: 00000100:00100000:1.0:1789023490.834808:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000033370a69 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5825:x1875927024796544:12345-0@lo:501: Request processed in 553us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023490.834819:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789023490.835088:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796544:0@lo:501: 00000100:00100000:0.0:1789023490.835145:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796672:0@lo:503: 00000100:00100000:0.0:1789023490.835208:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023490.835259:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000002004f547 going to sleep for 11 seconds 00000100:00100000:2.0:1789023490.835345:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796672 00000100:00100000:2.0:1789023490.835355:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796672 00000100:00100000:2.0:1789023490.835399:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789023490.835429:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000177a3b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5825:x1875927024796672:12345-0@lo:503: 00000100:00100000:2.0:1789023490.836095:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000177a3b88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5825:x1875927024796672:12345-0@lo:503: Request processed in 668us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023490.836108:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789023490.836355:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024796672:0@lo:503: 00000100:00100000:1.0:1789023490.837346:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001659484d pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5868:1875927024796800:0@lo:502: 00000100:00100000:1.0:1789023490.837425:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023490.837585:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 0000000004b328b2 going to sleep for 11 seconds 00000100:00100000:2.0:1789023490.837703:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796800 00000100:00100000:2.0:1789023490.837710:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796800 00000100:00100000:2.0:1789023490.837755:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789023490.837763:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006def158f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5868:x1875927024796800:12345-0@lo:502: 00000100:00100000:2.0:1789023490.838270:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006def158f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5868:x1875927024796800:12345-0@lo:502: Request processed in 505us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023490.838282:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023490.838756:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001659484d pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5868:1875927024796800:0@lo:502: 00000020:01000000:0.0:1789023490.838801:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023490.838817:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023490.838820:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789023490.838828:0:5868:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789023490.838832:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023490.839031:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000004dc5518d) 00000020:00000080:0.0:1789023490.839052:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789023490.839063:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789023490.839168:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789023490.839177:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb341795c 00000020:00000080:0.0:1789023490.839453:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789023490.839458:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023490.839462:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023490.839463:0:5868:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789023490.839472:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023490.840260:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023490.840266:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789023490.840278:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023490.840296:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000733266fb) 00000020:00000080:0.0:1789023490.840320:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789023490.840327:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789023490.840330:0:5868:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789023490.840333:0:5868:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789023490.840343:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789023490.840422:0:5868:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b55eb97 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789023490.840434:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c7b40272) 00000020:00000080:0.0:1789023490.840442:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789023490.841419:0:5868:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789023490.841431:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3417971 00000020:00000080:1.0:1789023490.842004:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789023490.842014:0:5868:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789023490.842022:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3c1fcbfb3417978 00080000:01000000:1.0:1789023490.842029:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789023490.842033:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb341797f 00080000:10000000:1.0:1789023490.843081:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789023490.843392:0:5868:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789023490.849098:0:5868:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789023490.992296:0:5868:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789023490.999988:0:5868:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789023491.005780:0:5868:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789023491.006767:0:5868:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789023491.077381:0:5868:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009eb395a9) 00000020:00000080:1.0:1789023491.077407:0:5868:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789023491.077514:0:5868:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789023491.077520:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb341798d 00000020:00000080:1.0:1789023491.084003:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789023491.085990:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789023491.139631:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789023491.174745:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789023491.220396:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789023491.251202:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789023491.305333:0:5868:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1789023491.341278:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789023491.392863:0:5868:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3c1fcbfb3417994 00000020:00000080:2.0:1789023491.395781:0:5868:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789023491.395890:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023491.395898:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023491.395901:0:5868:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789023491.395905:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023491.395909:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023491.395910:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789023491.395913:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789023491.395925:0:5868:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789023491.395928:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023491.395930:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023491.395931:0:5868:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789023491.395934:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023491.395938:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023491.395939:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789023491.395943:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789023491.395994:0:5868:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1789023491.396108:0:5868:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077c1db59 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5868:1875927024796928:0@lo:502: 00000100:00100000:2.0:1789023491.396190:0:5868:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023491.396249:0:5868:0:(client.c:2716:ptlrpc_set_wait()) set 000000006ef01058 going to sleep for 11 seconds 00000100:00100000:3.0:1789023491.396311:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024796928 00000100:00100000:3.0:1789023491.396318:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024796928 00000100:00100000:3.0:1789023491.396358:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789023491.396366:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9741b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5868:x1875927024796928:12345-0@lo:502: 00000100:00100000:3.0:1789023491.396746:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9741b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5868:x1875927024796928:12345-0@lo:502: Request processed in 381us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023491.396754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789023491.396889:0:5868:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077c1db59 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5868:1875927024796928:0@lo:502: 00000020:01000000:2.0:1789023491.396913:0:5868:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023491.396927:0:5868:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023491.396929:0:5868:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1789023491.396932:0:5868:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789023491.398266:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789023491.398296:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789023491.398320:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.398333:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023491.398342:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65d252c800 from 1 10000000:01000000:0.0:1789023491.398352:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789023491.398394:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.398401:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.398410:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023491.398445:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797056:0@lo:101: 00000100:00100000:0.0:1789023491.398522:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023491.398558:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000000459075c going to sleep for 11 seconds 00000100:00100000:2.0:1789023491.398583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797056 00000100:00100000:2.0:1789023491.398590:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797056 00000100:00100000:2.0:1789023491.398631:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789023491.398638:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006dd676fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+9:5825:x1875927024797056:12345-0@lo:101: 00010000:00010000:2.0:1789023491.398650:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023491.398663:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb341799b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.398684:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.398694:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.398701:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b2e25c3d, rc 0) 00000100:00100000:2.0:1789023491.398890:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006dd676fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+10:5825:x1875927024797056:12345-0@lo:101: Request processed in 253us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023491.398896:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789023491.399015:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797056:0@lo:101: 00010000:00010000:0.0:1789023491.399027:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.399036:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023491.399715:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797184:0@lo:256: 00000100:00100000:0.0:1789023491.399759:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023491.399790:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000000459075c going to sleep for 11 seconds 00000100:00100000:1.0:1789023491.403232:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797184 00000100:00100000:1.0:1789023491.403247:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797184 00000100:00100000:1.0:1789023491.403305:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023491.403315:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d1af5489 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+10:5825:x1875927024797184:12345-0@lo:256: 20000000:01000000:1.0:1789023491.403342:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789023491.403359:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789023491.403796:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d1af5489 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+10:5825:x1875927024797184:12345-0@lo:256: Request processed in 483us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023491.403804:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789023491.403893:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797184:0@lo:256: 10000000:01000000:0.0:1789023491.404998:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789023491.405011:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.405022:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023491.405030:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d252c800 from 1 10000000:01000000:0.0:1789023491.405033:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023491.405067:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.405074:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.405092:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023491.405112:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797312:0@lo:101: 00000100:00100000:0.0:1789023491.405160:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023491.405211:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000000459075c going to sleep for 11 seconds 00000100:00100000:3.0:1789023491.406238:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797312 00000100:00100000:3.0:1789023491.406251:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797312 00000100:00100000:3.0:1789023491.406313:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789023491.406321:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004e9fd995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:5825:x1875927024797312:12345-0@lo:101: 00010000:00010000:3.0:1789023491.406335:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023491.406352:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb34179a9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.406378:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.406389:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.406398:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d71aaa1, rc 0) 00000100:00100000:3.0:1789023491.406472:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004e9fd995 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5825:x1875927024797312:12345-0@lo:101: Request processed in 152us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023491.406510:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789023491.407213:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797312:0@lo:101: 00010000:00010000:0.0:1789023491.407238:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.407249:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023491.407324:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797440:0@lo:501: 00000100:00100000:0.0:1789023491.407384:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023491.407432:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000000459075c going to sleep for 11 seconds 00000100:00100000:2.0:1789023491.407474:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797440 00000100:00100000:2.0:1789023491.407514:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797440 00000100:00100000:2.0:1789023491.407564:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023491.407573:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe5ecd9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5825:x1875927024797440:12345-0@lo:501: 00000100:00100000:2.0:1789023491.408351:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe5ecd9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5825:x1875927024797440:12345-0@lo:501: Request processed in 778us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023491.408362:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023491.408961:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797440:0@lo:501: 00000100:00100000:0.0:1789023491.409018:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797568:0@lo:503: 00000100:00100000:0.0:1789023491.409084:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023491.409132:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000000459075c going to sleep for 11 seconds 00000100:00100000:1.0:1789023491.409394:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797568 00000100:00100000:1.0:1789023491.409403:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797568 00000100:00100000:1.0:1789023491.409461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789023491.409470:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000780d95d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5825:x1875927024797568:12345-0@lo:503: 00000040:00080000:1.0:1789023491.409549:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023491.409598:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000780d95d1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5825:x1875927024797568:12345-0@lo:503: Request processed in 129us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023491.409604:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023491.409657:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797568:0@lo:503: 00000040:00080000:0.0:1789023491.422035:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789023491.422518:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789023491.422540:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023491.422562:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.422573:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023491.422622:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789023491.422625:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e65d252c800 10000000:01000000:2.0:1789023491.422628:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e65d252c800 10000000:01000000:2.0:1789023491.422632:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789023491.422639:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65d252c800 from 1 10000000:01000000:2.0:1789023491.422642:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023491.422682:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.422690:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.422701:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023491.422739:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000077c1db59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797696:0@lo:101: 00000100:00100000:2.0:1789023491.422941:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023491.423001:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000001ec2c112 going to sleep for 11 seconds 00000100:00100000:3.0:1789023491.423083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797696 00000100:00100000:3.0:1789023491.423091:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797696 00000100:00100000:3.0:1789023491.423139:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023491.423153:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003e890385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5825:x1875927024797696:12345-0@lo:101: 00010000:00010000:3.0:1789023491.423167:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023491.423178:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb34179b7 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.423200:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.423211:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.423220:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003905238d, rc 0) 00000100:00100000:3.0:1789023491.423268:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003e890385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5825:x1875927024797696:12345-0@lo:101: Request processed in 116us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023491.423275:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789023491.423507:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000077c1db59 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797696:0@lo:101: 00010000:00010000:0.0:1789023491.423523:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.423539:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023491.423598:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797824:0@lo:501: 00000100:00100000:0.0:1789023491.423626:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023491.423650:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000004b7a1377 going to sleep for 11 seconds 00000100:00100000:1.0:1789023491.423963:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797824 00000100:00100000:1.0:1789023491.423970:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797824 00000100:00100000:1.0:1789023491.424012:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789023491.424019:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f85fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5825:x1875927024797824:12345-0@lo:501: 00000100:00100000:1.0:1789023491.424298:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f85fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5825:x1875927024797824:12345-0@lo:501: Request processed in 279us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023491.424305:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023491.425963:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b873e66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797824:0@lo:501: 00000100:00100000:1.0:1789023491.426526:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cbb370be pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797952:0@lo:503: 00000100:00100000:1.0:1789023491.426612:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023491.426663:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 000000009163960b going to sleep for 11 seconds 00000100:00100000:2.0:1789023491.427514:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024797952 00000100:00100000:2.0:1789023491.427524:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024797952 00000100:00100000:2.0:1789023491.427572:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789023491.427579:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bba09f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5825:x1875927024797952:12345-0@lo:503: 00000100:00100000:2.0:1789023491.428015:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bba09f25 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5825:x1875927024797952:12345-0@lo:503: Request processed in 436us (1403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023491.428023:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789023491.429662:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cbb370be pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024797952:0@lo:503: 00000100:00100000:2.0:1789023491.430167:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000153f455a pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5873:1875927024798080:0@lo:502: 00000100:00100000:2.0:1789023491.430237:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023491.430276:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 000000004c9d284e going to sleep for 11 seconds 00000100:00100000:3.0:1789023491.430332:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798080 00000100:00100000:3.0:1789023491.430339:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798080 00000100:00100000:3.0:1789023491.430383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023491.430391:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005854446b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5873:x1875927024798080:12345-0@lo:502: 00000100:00100000:3.0:1789023491.430717:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005854446b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5873:x1875927024798080:12345-0@lo:502: Request processed in 326us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023491.430724:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789023491.430995:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000153f455a pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5873:1875927024798080:0@lo:502: 00000020:01000004:0.0:1789023491.431051:0:5873:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789023491.431076:0:5873:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000a9d9ecb1) 00000020:00000080:0.0:1789023491.431094:0:5873:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1789023491.431166:0:5873:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009b55eb97 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789023491.431170:0:5873:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009b55eb97 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789023491.431172:0:5873:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009b55eb97 4 00010000:00080000:0.0:1789023491.431197:0:5873:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000078764a54@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789023491.433980:0:5873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1789023491.434219:0:5873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789023491.434258:0:5873:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789023491.434273:0:5873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3c1fcbfb34179cc 00000100:00080000:0.0:1789023491.434283:0:5873:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023491.434293:0:5873:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000078764a54 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789023491.434341:0:5873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000bc50810e x1875927024798208/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789023491.434370:0:5873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789023491.434468:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc50810e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024798208:0@lo:38: 00000100:00100000:3.0:1789023491.434575:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023491.434642:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798208 00000100:00100000:3.0:1789023491.434649:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798208 00000100:00100000:3.0:1789023491.434677:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023491.434691:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000441bafe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875927024798208:12345-0@lo:38: 00000100:00100000:3.0:1789023491.434738:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000441bafe8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875927024798208:12345-0@lo:38: Request processed in 47us (164us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789023491.434744:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023491.434784:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789023491.434792:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000078764a54 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789023491.434796:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789023491.434799:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc50810e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024798208:0@lo:38: 00000100:00100000:3.0:1789023491.435993:0:5873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8f96edf pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5873:1875927024798336:0@lo:502: 00000100:00100000:3.0:1789023491.436054:0:5873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023491.436087:0:5873:0:(client.c:2716:ptlrpc_set_wait()) set 000000001694f73e going to sleep for 11 seconds 00000100:00100000:1.0:1789023491.441573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798336 00000100:00100000:1.0:1789023491.441591:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798336 00000100:00100000:1.0:1789023491.441646:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789023491.441654:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001cd92afd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5873:x1875927024798336:12345-0@lo:502: 00000100:00100000:1.0:1789023491.441966:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001cd92afd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5873:x1875927024798336:12345-0@lo:502: Request processed in 313us (5912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023491.441976:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789023491.442057:0:5873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8f96edf pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:5873:1875927024798336:0@lo:502: 00000040:00080000:1.0:1789023491.442095:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789023491.442335:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789023491.442378:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789023491.442400:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.442410:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789023491.442462:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789023491.442465:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789023491.442467:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023491.442468:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023491.442469:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023491.442471:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023491.442472:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789023491.442473:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789023491.442496:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023491.442497:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023491.442499:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023491.442501:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789023491.442512:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789023491.442514:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789023491.442516:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789023491.442516:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023491.442517:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023491.442518:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023491.442519:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023491.442520:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789023491.442521:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789023491.442522:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023491.442522:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023491.442523:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023491.442524:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789023491.442550:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789023491.442566:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d94dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024798464:0@lo:253: 00000100:00100000:3.0:1789023491.442608:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023491.442646:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa5bb89b going to sleep for 11 seconds 00000100:00100000:0.0:1789023491.443590:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798464 00000100:00100000:0.0:1789023491.443616:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798464 00000100:00100000:0.0:1789023491.443670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023491.443679:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000935b831f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5825:x1875927024798464:12345-0@lo:253: 20000000:01000000:0.0:1789023491.443706:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789023491.443720:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789023491.504597:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789023491.504626:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789023491.504683:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789023491.504688:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789023491.504709:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.504729:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.504736:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.504780:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023491.504798:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 12 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023491.504816:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce0036c6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875927024798592:0@lo:104: 00000100:00100000:3.0:1789023491.504908:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023491.504984:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 0000000023f71f3f going to sleep for 11 seconds 00000100:00100000:2.0:1789023491.505070:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798592 00000100:00100000:2.0:1789023491.505080:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798592 00000100:00100000:2.0:1789023491.505133:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023491.505143:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a9a7c790 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5861:x1875927024798592:12345-0@lo:104: 00010000:00010000:2.0:1789023491.505159:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.505215:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789023491.505221:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a9a7c790 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5861:x1875927024798592:12345-0@lo:104: Request processed in 79us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023491.505227:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789023491.505246:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023491.505251:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.505258:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002d324e6 already unused, calling callback (00000000c0a5e8dd) 10000000:00010000:2.0:1789023491.505261:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.505277:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023491.505283:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023491.505287:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789023491.505317:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.505323:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789023491.505339:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.505364:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 0000000002d324e6/0xc3c1fcbfb341799b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179a2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.505381:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023491.505383:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023491.505384:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023491.505470:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024b752ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024798720:0@lo:103: 00000100:00100000:2.0:1789023491.505534:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023491.505577:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce0036c6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875927024798592:0@lo:104: 00010000:00010000:2.0:1789023491.505598:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023491.506235:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798720 00000100:00100000:0.0:1789023491.506243:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798720 00010000:00010000:0.0:1789023491.506265:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 13 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023491.506297:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023491.506305:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000527d9b1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3311:x1875927024798720:12345-0@lo:103: 00010000:00010000:0.0:1789023491.506318:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023491.506323:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 13 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506333:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 13 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506459:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b2e25c3d/0xc3c1fcbfb34179a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb341799b expref: 13 pid: 5839 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506501:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506509:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789023491.506523:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001836095s 00010000:00010000:0.0:1789023491.506526:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506547:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506552:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506556:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506561:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b83cdbb2 already unused, calling callback (0000000030c87fcd) 00010000:00010000:0.0:1789023491.506564:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506570:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506584:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023491.506593:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023491.506648:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000527d9b1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:3311:x1875927024798720:12345-0@lo:103: Request processed in 344us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023491.506654:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023491.506729:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024b752ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024798720:0@lo:103: 00010000:00010000:2.0:1789023491.506871:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.506890:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023491.506895:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b83cdbb2/0xc3c1fcbfb34179d3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023491.524383:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000935b831f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5825:x1875927024798464:12345-0@lo:253: Request processed in 80697us (81766us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023491.524400:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789023491.524744:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d94dd2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:5825:1875927024798464:0@lo:253: 10000000:01000000:3.0:1789023491.524763:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789023491.524767:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789023491.524769:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789023491.524771:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023491.524772:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023491.524773:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023491.524774:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023491.524775:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789023491.524777:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789023491.524778:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789023491.524779:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789023491.524781:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023491.524782:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789023491.524804:0:5825:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789023491.535126:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023491.535814:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023491.536050:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023491.536228:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023491.536761:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023491.536998:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023491.538108:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023491.538317:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023491.538624:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023491.538812:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023491.539011:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023491.539200:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789023491.577069:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789023491.605454:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789023491.605675:0:5878:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789023491.605680:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789023491.605798:0:5879:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789023491.612221:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789023491.612667:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789023491.613068:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789023491.613078:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789023491.613218:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023491.614152:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789023491.614718:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789023491.614748:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789023491.624156:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789023491.624436:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789023491.628557:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789023491.628700:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789023491.628850:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789023491.629028:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789023491.629164:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789023491.629309:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789023491.629451:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789023491.629622:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789023491.629756:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789023491.629903:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789023491.632312:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789023491.632879:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789023491.633034:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789023491.633200:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789023491.633956:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789023491.634157:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789023491.634696:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789023491.634856:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789023491.635006:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789023491.635162:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789023491.635295:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789023491.635776:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789023491.635946:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789023491.636111:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789023491.636250:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789023491.636780:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789023491.636944:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789023491.637101:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789023491.637256:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789023491.641327:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789023491.641597:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789023491.641770:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789023491.642091:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1789023491.668652:0:5879:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789023491.721934:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789023491.721976:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9c3b4184b988 00100000:10000000:3.0:1789023491.721984:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789023491.722758:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789023491.722773:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789023491.722785:0:5825:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789023491.722810:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1789023491.775987:0:5879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789023491.776080:0:5879:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789023491.776085:0:5879:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789023492.364720:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023493.392770:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023494.414051:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023495.434341:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023496.089667:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789023496.457808:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789023496.714808:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789023496.714818:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789023496.714822:0:36:0:(import.c:65:import_set_state_nolock()) 0000000078764a54 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789023496.714842:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000078764a54 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789023496.714864:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002d2cb670 x1875927024798976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789023496.714957:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d94dd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024798848:0@lo:400: 00000100:00100000:3.0:1789023496.715038:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023496.715144:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d2cb670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024798976:0@lo:38: 00000100:00100000:3.0:1789023496.715175:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023496.715225:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798848 00000100:00100000:3.0:1789023496.715232:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798848 00000100:00100000:3.0:1789023496.715270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789023496.715278:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000508829c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3312:x1875927024798848:12345-0@lo:400: 00000100:00100000:3.0:1789023496.715326:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000508829c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3312:x1875927024798848:12345-0@lo:400: Request processed in 49us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023496.715333:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789023496.715388:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d94dd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024798848:0@lo:400: 00000100:00100000:3.0:1789023496.715430:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024798976 00000100:00100000:3.0:1789023496.715434:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024798976 00000100:00100000:3.0:1789023496.715455:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023496.715459:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000065e7f069 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875927024798976:12345-0@lo:38: 00010000:00080000:3.0:1789023496.715514:0:5847:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:3.0:1789023496.715550:0:5847:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3c1fcbfb34179da 00000004:00100000:3.0:1789023496.715592:0:5847:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789023496.715740:0:5847:0:(import.c:65:import_set_state_nolock()) 000000001a19c0f7 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023496.715980:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000065e7f069 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875927024798976:12345-0@lo:38: Request processed in 519us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023496.715994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789023496.716321:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002d2cb670 x1875927024798976/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789023496.716337:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789023496.716344:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789023496.716349:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789023496.716351:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000078764a54 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789023496.716356:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d2cb670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024798976:0@lo:38: 00010000:00010000:0.0:1789023497.486339:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023498.509276:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023499.536369:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789023500.298513:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789023500.298522:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65d252c800 from 3 10000000:01000000:1.0:1789023500.298528:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789023500.298589:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000c7348d73/0xc3c1fcbfb34179e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023500.298602:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000c7348d73/0xc3c1fcbfb34179e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023500.298612:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000c7348d73/0xc3c1fcbfb34179e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023500.298634:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024799104:0@lo:101: 00000100:00100000:1.0:1789023500.298706:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023500.298775:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000003594ee76 going to sleep for 11 seconds 00000100:00100000:2.0:1789023500.299391:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024799104 00000100:00100000:2.0:1789023500.299401:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024799104 00000100:00100000:2.0:1789023500.299465:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023500.299473:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8ce6a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5843:x1875927024799104:12345-0@lo:101: 00010000:00010000:2.0:1789023500.299520:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023500.299537:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000548fda4e/0xc3c1fcbfb34179e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb34179e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023500.299563:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000548fda4e/0xc3c1fcbfb34179e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023500.299573:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000548fda4e/0xc3c1fcbfb34179e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023500.299583:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000548fda4e, rc 0) 00000100:00100000:2.0:1789023500.299628:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8ce6a71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024799104:12345-0@lo:101: Request processed in 156us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023500.299634:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023500.301308:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024799104:0@lo:101: 00010000:00010000:1.0:1789023500.301335:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000c7348d73/0xc3c1fcbfb34179e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023500.301346:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000c7348d73/0xc3c1fcbfb34179e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023500.301423:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024799232:0@lo:256: 00000100:00100000:1.0:1789023500.302137:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023500.302246:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set 000000003594ee76 going to sleep for 11 seconds 00000100:00100000:3.0:1789023500.307081:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024799232 00000100:00100000:3.0:1789023500.307096:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024799232 00000100:00100000:2.0:1789023500.307312:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789023500.307323:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005d4e2741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024799232:12345-0@lo:256: 20000000:01000000:2.0:1789023500.307348:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789023500.307370:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789023500.307373:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1789023500.307530:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005d4e2741 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024799232:12345-0@lo:256: Request processed in 209us (5395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023500.307538:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789023500.307633:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024799232:0@lo:256: 10000000:01000000:1.0:1789023500.307683:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789023500.307691:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000c7348d73/0xc3c1fcbfb34179e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023500.307702:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000c7348d73/0xc3c1fcbfb34179e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023500.560727:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789023501.099119:0:6323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2ccf1680 20000000:00000080:0.0:1789023501.099136:0:6323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e65d09cf400 uarg=0000000000000000 20000000:01000000:0.0:1789023501.099186:0:6323:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789023501.099194:0:6323:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789023501.099206:0:6323:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789023501.099553:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789023501.099565:0:6323:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789023501.106811:0:6323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023501.107096:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789023501.107311:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789023501.107371:0:6323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789023501.107389:0:6323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789023501.107407:0:6323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.107428:0:6323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.107436:0:6323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.107471:0:6323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.110956:0:6323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 11 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023501.110975:0:6323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a602fea pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1875927024799360:0@lo:104: 00000100:00100000:2.0:1789023501.111234:0:6323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023501.111307:0:6323:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c504e4b4 going to sleep for 11 seconds 00000100:00100000:0.0:1789023501.111704:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024799360 00000100:00100000:0.0:1789023501.111713:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024799360 00000100:00100000:0.0:1789023501.111763:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023501.111771:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009a0ab425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:6323:x1875927024799360:12345-0@lo:104: 00010000:00010000:0.0:1789023501.111788:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.111882:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023501.111888:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009a0ab425 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:6323:x1875927024799360:12345-0@lo:104: Request processed in 118us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023501.111896:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789023501.111929:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023501.111934:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.111941:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7285453 already unused, calling callback (00000000c0a5e8dd) 10000000:00010000:0.0:1789023501.111944:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.111952:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023501.111959:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023501.111964:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789023501.112000:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.112007:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023501.112023:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.112029:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000d7285453/0xc3c1fcbfb34179a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179b0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023501.112055:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023501.112057:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023501.112058:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023501.112070:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000442b5cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024799488:0@lo:103: 00000100:00100000:0.0:1789023501.112330:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023501.113060:0:6323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a602fea pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6323:1875927024799360:0@lo:104: 00010000:00010000:2.0:1789023501.113091:0:6323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023501.113783:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024799488 00000100:00100000:2.0:1789023501.113793:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024799488 00010000:00010000:2.0:1789023501.113823:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 12 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023501.113901:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023501.113909:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008f7a674c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:3313:x1875927024799488:12345-0@lo:103: 00010000:00010000:2.0:1789023501.113921:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023501.113927:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 12 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.113936:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 12 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.113950:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d71aaa1/0xc3c1fcbfb34179b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb34179a9 expref: 12 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.113962:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.113970:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.113984:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.113991:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.113997:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.114010:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.114015:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d1b31cc2 already unused, calling callback (0000000030c87fcd) 00010000:00010000:2.0:1789023501.114018:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.114026:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.114045:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023501.114055:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023501.114233:0:6323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023501.114241:0:6323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023501.114246:0:6323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d1b31cc2/0xc3c1fcbfb34179ef lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023501.115225:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008f7a674c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3313:x1875927024799488:12345-0@lo:103: Request processed in 1313us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023501.115235:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023501.115785:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000442b5cd7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024799488:0@lo:103: 00010000:00010000:1.0:1789023501.577651:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023501.834675:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d2cb670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024799616:0@lo:400: 00000100:00100000:0.0:1789023501.834800:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023501.834911:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024799616 00000100:00100000:3.0:1789023501.834919:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024799616 00000100:00100000:3.0:1789023501.834973:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023501.834980:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000619107b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024799616:12345-0@lo:400: 00000100:00100000:3.0:1789023501.835030:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000619107b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024799616:12345-0@lo:400: Request processed in 51us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023501.835038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789023501.835134:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002d2cb670 x1875927024799616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023501.835149:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d2cb670 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024799616:0@lo:400: 00010000:00010000:0.0:1789023502.601764:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023503.626699:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023504.657184:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023505.673734:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023506.699214:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023506.954577:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a2d94dd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024799744:0@lo:400: 00000100:00100000:3.0:1789023506.954648:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023506.954708:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c945e95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024799872:0@lo:400: 00000100:00100000:3.0:1789023506.954733:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023506.954765:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024799744 00000100:00100000:3.0:1789023506.954772:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024799744 00000100:00100000:3.0:1789023506.954819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789023506.954828:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000148d9b29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3311:x1875927024799744:12345-0@lo:400: 00000100:00100000:3.0:1789023506.954871:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000148d9b29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3311:x1875927024799744:12345-0@lo:400: Request processed in 45us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023506.954885:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789023506.954914:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024799872 00000100:00100000:3.0:1789023506.954917:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024799872 00000100:00100000:3.0:1789023506.954940:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023506.954946:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000587ed212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024799872:12345-0@lo:400: 00000100:00100000:3.0:1789023506.954980:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000587ed212 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024799872:12345-0@lo:400: Request processed in 35us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023506.954986:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789023506.957332:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004c945e95 x1875927024799872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023506.957352:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c945e95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024799872:0@lo:400: 00000100:00100000:3.0:1789023506.957465:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a2d94dd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024799744:0@lo:400: 00000020:01000004:1.0:1789023507.238552:0:6692:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789023507.238556:0:6692:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789023507.238706:0:6692:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000aecc76e1 00000020:01000004:1.0:1789023507.238722:0:6692:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789023507.238733:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789023507.238746:0:6692:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (0000000044b14df2) 00000020:00000080:1.0:1789023507.238760:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789023507.252130:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789023507.252442:0:6692:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789023507.273303:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789023507.289219:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789023507.289252:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789023507.289315:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789023507.289341:0:6692:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789023507.290126:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789023507.290137:0:6692:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789023507.290147:0:6692:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3c1fcbfb34179fd 00000020:01000004:2.0:1789023507.290155:0:6692:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789023507.290174:0:6692:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789023507.290182:0:6692:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789023507.290188:0:6692:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789023507.290193:0:6692:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789023507.290205:0:6692:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000b3fca7f0) 00000020:00000080:2.0:1789023507.290218:0:6692:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789023507.291803:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023507.293979:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789023507.293992:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789023507.297904:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789023507.298040:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789023507.300359:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789023507.300441:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789023507.303067:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023507.303266:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789023507.303272:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789023507.304178:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789023507.304188:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789023507.339804:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023507.340174:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789023507.340181:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789023507.344208:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789023507.344223:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789023507.345359:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789023507.345370:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789023507.351845:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023507.352274:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789023507.352280:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789023507.354383:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789023507.354395:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789023507.441821:0:6692:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789023507.442505:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789023507.442524:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789023507.444891:0:6692:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789023507.444968:0:6692:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789023507.445475:0:6692:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789023507.445562:0:6692:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789023507.445567:0:6692:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789023507.473922:0:6692:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789023507.473958:0:6692:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789023507.473962:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789023507.473964:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789023507.473965:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023507.473967:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023507.473968:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023507.473969:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023507.473970:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023507.473971:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023507.473972:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023507.473973:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023507.473974:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789023507.473977:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789023507.473980:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789023507.473985:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789023507.473986:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023507.473987:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023507.473988:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023507.473988:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023507.473989:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023507.473990:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023507.473991:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023507.473992:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023507.473992:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789023507.474017:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789023507.474032:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b64482e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024800000:0@lo:253: 00000100:00100000:2.0:1789023507.474095:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023507.474154:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 000000009dfbfdd3 going to sleep for 11 seconds 00000100:00100000:3.0:1789023507.474207:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800000 00000100:00100000:3.0:1789023507.474216:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800000 00000100:00100000:3.0:1789023507.474267:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023507.474275:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a5e32a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024800000:12345-0@lo:253: 20000000:01000000:3.0:1789023507.474303:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789023507.474322:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789023507.474327:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789023507.474330:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789023507.475184:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023507.475399:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1789023507.475411:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789023507.475444:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1789023507.475451:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789023507.475473:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1789023507.475547:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1789023507.475868:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789023507.475886:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789023507.475888:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789023507.475923:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789023507.475931:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789023507.476003:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789023507.476011:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789023507.476045:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789023507.476055:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789023507.476085:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789023507.476135:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789023507.476874:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789023507.476893:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:3.0:1789023507.476895:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789023507.476930:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789023507.476938:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789023507.476969:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789023507.476976:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:3.0:1789023507.477020:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789023507.477029:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789023507.477060:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789023507.477095:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789023507.477120:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789023507.477123:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789023507.477127:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789023507.477138:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789023507.477141:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789023507.477173:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789023507.477176:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789023507.483062:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789023507.483155:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789023507.483212:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789023507.483570:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789023507.483614:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789023507.483668:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789023507.483680:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789023507.483683:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789023507.485466:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789023507.485612:0:6707:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789023507.485664:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789023507.485990:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789023507.486034:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789023507.486068:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789023507.486082:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789023507.486085:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789023507.489197:0:6708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789023507.490091:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789023507.490148:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789023507.490205:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789023507.490224:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789023507.490227:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789023507.490236:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789023507.490255:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490281:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490288:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490294:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490300:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490340:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490357:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 11 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023507.490373:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875927024800128:0@lo:104: 00000100:00100000:0.0:1789023507.490441:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789023507.490525:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490535:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 11 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023507.490544:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4b544e3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875927024800256:0@lo:104: 00000100:00100000:0.0:1789023507.490566:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.490597:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800128 00000100:00100000:0.0:1789023507.490612:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800128 00000100:00100000:0.0:1789023507.490666:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800256 00000100:00100000:0.0:1789023507.490668:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800256 00000100:00100000:0.0:1789023507.490682:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023507.490688:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ddc60b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:5840:x1875927024800128:12345-0@lo:104: 00010000:00010000:0.0:1789023507.490697:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490740:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023507.490744:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ddc60b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:5840:x1875927024800128:12345-0@lo:104: Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.490751:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023507.490765:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023507.490770:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7bdc15b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5840:x1875927024800256:12345-0@lo:104: 00010000:00010000:0.0:1789023507.490776:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490800:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789023507.490804:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7bdc15b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5840:x1875927024800256:12345-0@lo:104: Request processed in 35us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.490822:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789023507.490840:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023507.490845:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490852:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df78aea4 already unused, calling callback (00000000c0a5e8dd) 10000000:00010000:0.0:1789023507.490855:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490871:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023507.490876:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023507.490881:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023507.490904:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490910:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023507.490922:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490928:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000df78aea4/0xc3c1fcbfb34179b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179be expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490938:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023507.490940:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490945:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000467e0471 already unused, calling callback (00000000c0a5e8dd) 10000000:00010000:0.0:1789023507.490948:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490953:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023507.490958:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023507.490967:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023507.490978:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490983:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023507.490992:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.490998:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417947 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb341794e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491007:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.491009:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.491011:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.491036:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491043:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023507.491050:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052cd247c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875927024800640:0@lo:104: 00000100:00100000:0.0:1789023507.491071:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.491087:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800640 00000100:00100000:0.0:1789023507.491090:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800640 00000100:00100000:0.0:1789023507.491107:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789023507.491112:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b22eace4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5840:x1875927024800640:12345-0@lo:104: 00010000:00010000:0.0:1789023507.491118:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491153:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023507.491157:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b22eace4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5840:x1875927024800640:12345-0@lo:104: Request processed in 46us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.491163:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789023507.491176:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023507.491179:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491184:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000092bb2313 already unused, calling callback (00000000c0a5e8dd) 10000000:00010000:0.0:1789023507.491187:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491192:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023507.491198:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023507.491203:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023507.491216:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491221:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023507.491225:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491231:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 0000000092bb2313/0xc3c1fcbfb341792b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417932 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.491250:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.491252:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.491253:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023507.491266:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 000000003594ee76 going to sleep for 11 seconds 00000100:00100000:0.0:1789023507.491286:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875927024800128:0@lo:104: 00000100:00100000:0.0:1789023507.491295:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4b544e3 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875927024800256:0@lo:104: 00000100:00100000:0.0:1789023507.491300:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052cd247c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5840:1875927024800640:0@lo:104: 00010000:00010000:0.0:1789023507.491319:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.492300:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023507.492316:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c7c27bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024800384:0@lo:103: 00000100:00100000:3.0:1789023507.492362:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023507.492414:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033298677 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024800512:0@lo:103: 00000100:00100000:3.0:1789023507.492434:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023507.492452:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023507.492457:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d52204cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024800768:0@lo:103: 00000100:00100000:3.0:1789023507.492472:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023507.492525:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800384 00000100:00100000:3.0:1789023507.492531:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800384 00010000:00010000:3.0:1789023507.492555:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 12 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023507.492572:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800512 00000100:00100000:3.0:1789023507.492575:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800512 00010000:00010000:3.0:1789023507.492583:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 13 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023507.492593:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800768 00000100:00100000:3.0:1789023507.492596:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800768 00000100:00100000:0.0:1789023507.492691:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023507.492699:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2d94dd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:3313:x1875927024800384:12345-0@lo:103: 00010000:00010000:0.0:1789023507.492709:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023507.492713:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.492723:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.492736:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003905238d/0xc3c1fcbfb34179be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb34179b7 expref: 14 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.492749:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023507.492781:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2d94dd2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3313:x1875927024800384:12345-0@lo:103: Request processed in 84us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.492787:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023507.492801:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789023507.492825:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 12 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023507.492861:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004c945e95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:3310:x1875927024800512:12345-0@lo:103: 00010000:00010000:0.0:1789023507.492869:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023507.492872:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 12 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.492879:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 12 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.492887:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000eff1acc1/0xc3c1fcbfb341794e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417947 expref: 12 pid: 5840 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.492896:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023507.492920:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004c945e95 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3310:x1875927024800512:12345-0@lo:103: Request processed in 62us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.493764:0:5831:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789023507.493774:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1789023507.493788:0:5832:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789023507.493796:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023507.493803:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af297763 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3310:x1875927024800768:12345-0@lo:103: 00010000:00010000:3.0:1789023507.493824:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023507.493829:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493839:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493851:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417932 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb341792b expref: 11 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493862:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493869:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493881:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493887:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493892:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493910:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493915:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000193a7a18 already unused, calling callback (0000000030c87fcd) 00010000:00010000:3.0:1789023507.493918:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493925:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493939:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.493948:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023507.493988:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af297763 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:3310:x1875927024800768:12345-0@lo:103: Request processed in 187us (1515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.493994:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023507.494038:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d52204cb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024800768:0@lo:103: 00000100:00100000:3.0:1789023507.494047:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033298677 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024800512:0@lo:103: 00000100:00100000:3.0:1789023507.494073:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c7c27bd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024800384:0@lo:103: 00010000:00010000:3.0:1789023507.494158:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.494166:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.494171:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000193a7a18/0xc3c1fcbfb3417a0b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789023507.494192:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789023507.498502:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023507.595768:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a5e32a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+8:6692:x1875927024800000:12345-0@lo:253: Request processed in 121487us (121666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.595784:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023507.595936:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b64482e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024800000:0@lo:253: 10000000:01000000:2.0:1789023507.595951:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789023507.595954:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789023507.595956:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789023507.595958:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023507.595959:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789023507.595960:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023507.595961:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023507.595963:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023507.595964:0:6692:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789023507.595965:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023507.595966:0:6692:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789023507.595984:0:6692:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000aecc76e1 from lustre-OST0000 10000000:01000000:2.0:1789023507.596008:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789023507.596023:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789023507.596029:0:6692:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e65d2720000 local copy 10000000:01000000:2.0:1789023507.596033:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789023507.596066:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.596076:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.596085:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023507.596102:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b64482e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024800896:0@lo:101: 00000100:00100000:2.0:1789023507.596136:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023507.596256:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da22477b going to sleep for 11 seconds 00000100:00100000:3.0:1789023507.596583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024800896 00000100:00100000:3.0:1789023507.596591:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024800896 00000100:00100000:3.0:1789023507.596634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789023507.596643:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000daa0da2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+8:6692:x1875927024800896:12345-0@lo:101: 00010000:00010000:3.0:1789023507.596655:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023507.596668:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417a19 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a12 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.596689:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a12 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.596699:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417a19 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a12 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.596707:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f99fa5a8, rc 0) 00000100:00100000:3.0:1789023507.596791:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000daa0da2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+9:6692:x1875927024800896:12345-0@lo:101: Request processed in 150us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.596798:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789023507.596905:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b64482e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024800896:0@lo:101: 00010000:00010000:0.0:1789023507.596918:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.596927:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023507.597041:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052cd247c pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801024:0@lo:501: 00000100:00100000:0.0:1789023507.597068:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.597130:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b544edd9 going to sleep for 11 seconds 00000100:00100000:3.0:1789023507.597170:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801024 00000100:00100000:3.0:1789023507.597174:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801024 00000100:00100000:3.0:1789023507.597295:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023507.597303:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3fa229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:6692:x1875927024801024:12345-0@lo:501: 00000100:00100000:3.0:1789023507.597647:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3fa229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+9:6692:x1875927024801024:12345-0@lo:501: Request processed in 345us (578us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789023507.597655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789023507.597743:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052cd247c pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801024:0@lo:501: 10000000:01000000:2.0:1789023507.597760:0:6692:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789023507.597787:0:6692:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789023507.597791:0:6692:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.597801:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.597819:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.597874:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789023507.597894:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e65d089d800 10000000:01000000:2.0:1789023507.597900:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789023507.597912:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e65d2720000 10000000:01000000:2.0:1789023507.597914:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789023507.597917:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e65d2720000 from 1 10000000:01000000:2.0:1789023507.597919:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789023507.597939:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 000000004b4947d8/0xc3c1fcbfb3417a20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.597946:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 000000004b4947d8/0xc3c1fcbfb3417a20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.597953:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 000000004b4947d8/0xc3c1fcbfb3417a20 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023507.597964:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000292d003e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801152:0@lo:101: 00000100:00100000:2.0:1789023507.597990:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023507.598064:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 000000006686ebeb going to sleep for 11 seconds 00000100:00100000:3.0:1789023507.598107:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801152 00000100:00100000:3.0:1789023507.598117:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801152 00000100:00100000:3.0:1789023507.598148:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789023507.598154:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000426a470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+9:6692:x1875927024801152:12345-0@lo:101: 00010000:00010000:3.0:1789023507.598162:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023507.598173:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059ec2c3b/0xc3c1fcbfb3417a27 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a20 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.598189:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059ec2c3b/0xc3c1fcbfb3417a27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a20 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.598198:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059ec2c3b/0xc3c1fcbfb3417a27 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a20 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.598205:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059ec2c3b, rc 0) 00000100:00100000:3.0:1789023507.598249:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000426a470 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801152:12345-0@lo:101: Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.598255:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789023507.598384:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000292d003e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801152:0@lo:101: 00010000:00010000:2.0:1789023507.598395:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 000000004b4947d8/0xc3c1fcbfb3417a20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a27 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.598403:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 000000004b4947d8/0xc3c1fcbfb3417a20 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417a27 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023507.598417:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789023507.598433:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 000000004b4947d8/0xc3c1fcbfb3417a20 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a27 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.598440:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 000000004b4947d8/0xc3c1fcbfb3417a20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a27 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023507.598457:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789023507.598460:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789023507.598464:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789023507.598466:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789023507.598500:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000eff1acc1/0xc3c1fcbfb3417a2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.598507:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000eff1acc1/0xc3c1fcbfb3417a2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.598513:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000eff1acc1/0xc3c1fcbfb3417a2e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023507.598524:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000292d003e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801280:0@lo:101: 00000100:00100000:2.0:1789023507.598551:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023507.598567:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 000000006686ebeb going to sleep for 11 seconds 00000100:00100000:3.0:1789023507.598917:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801280 00000100:00100000:3.0:1789023507.598923:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801280 00000100:00100000:3.0:1789023507.598962:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789023507.598968:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dd088eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801280:12345-0@lo:101: 00010000:00010000:3.0:1789023507.598976:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023507.598985:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000739b8b7d/0xc3c1fcbfb3417a35 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a2e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.598999:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000739b8b7d/0xc3c1fcbfb3417a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.599007:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000739b8b7d/0xc3c1fcbfb3417a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.599025:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000739b8b7d, rc 0) 00000100:00100000:3.0:1789023507.599057:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dd088eaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024801280:12345-0@lo:101: Request processed in 90us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.599063:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1789023507.599139:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023507.599150:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.599157:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b2e25c3d already unused, calling callback (00000000c0a5e8dd) 10000000:00010000:0.0:1789023507.599159:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.599166:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023507.599173:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023507.599178:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023507.599197:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.599202:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023507.599223:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023507.599327:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4b544e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024801408:0@lo:103: 00000100:00100000:3.0:1789023507.599355:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023507.599401:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801408 00000100:00100000:3.0:1789023507.599405:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801408 00000100:00100000:3.0:1789023507.599429:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023507.599433:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000088c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3312:x1875927024801408:12345-0@lo:103: 00010000:00010000:3.0:1789023507.599440:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023507.599450:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f99fa5a8/0xc3c1fcbfb3417a19 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a12 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023507.599461:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023507.599507:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000088c6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:3312:x1875927024801408:12345-0@lo:103: Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.599513:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023507.599538:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4b544e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024801408:0@lo:103: 00010000:00010000:0.0:1789023507.599656:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: 00000000b2e25c3d/0xc3c1fcbfb3417a12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3c1fcbfb3417a19 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.599665:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.599667:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.599668:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023507.599726:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000292d003e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801280:0@lo:101: 00010000:00010000:2.0:1789023507.599737:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000eff1acc1/0xc3c1fcbfb3417a2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.599745:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000eff1acc1/0xc3c1fcbfb3417a2e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023507.599844:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000292d003e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801536:0@lo:501: 00000100:00100000:2.0:1789023507.599869:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023507.599899:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 000000006686ebeb going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.599914:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801536 00000100:00100000:2.0:1789023507.599926:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801536 00000100:00100000:2.0:1789023507.599947:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789023507.599953:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000045245200 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801536:12345-0@lo:501: 00000100:00100000:2.0:1789023507.600249:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000045245200 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801536:12345-0@lo:501: Request processed in 296us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.600256:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023507.600462:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000292d003e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801536:0@lo:501: 00000100:00100000:0.0:1789023507.600600:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801664:0@lo:503: 00000100:00100000:0.0:1789023507.600639:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.600705:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 00000000462751c1 going to sleep for 11 seconds 00000100:00100000:3.0:1789023507.600735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801664 00000100:00100000:3.0:1789023507.600740:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801664 00000100:00100000:3.0:1789023507.600805:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789023507.600821:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000de41dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801664:12345-0@lo:503: 00000100:00100000:3.0:1789023507.601028:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000de41dc5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801664:12345-0@lo:503: Request processed in 208us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.601044:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023507.601110:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801664:0@lo:503: 00000040:00080000:0.0:1789023507.601424:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789023507.601504:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801792:0@lo:502: 00000100:00100000:0.0:1789023507.601536:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.604979:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 00000000462751c1 going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.605087:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801792 00000100:00100000:2.0:1789023507.605097:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801792 00000100:00100000:2.0:1789023507.605140:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789023507.605149:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003a2f997d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801792:12345-0@lo:502: 00000100:00100000:2.0:1789023507.605661:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003a2f997d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801792:12345-0@lo:502: Request processed in 512us (4122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.605669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789023507.605790:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801792:0@lo:502: 00000040:00080000:0.0:1789023507.606065:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789023507.606120:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789023507.606153:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789023507.606199:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789023507.606248:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789023507.606281:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789023507.606316:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801920:0@lo:502: 00000100:00100000:0.0:1789023507.606551:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.606583:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 00000000462751c1 going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.606652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024801920 00000100:00100000:2.0:1789023507.606659:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024801920 00000100:00100000:2.0:1789023507.606688:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789023507.606695:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f41ade98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801920:12345-0@lo:502: 00000100:00100000:2.0:1789023507.606870:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f41ade98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024801920:12345-0@lo:502: Request processed in 175us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.606877:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789023507.614206:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024801920:0@lo:502: 00000040:00080000:0.0:1789023507.614422:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789023507.614437:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1789023507.616980:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789023507.616992:0:6712:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789023507.616997:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023507.616999:0:6712:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789023507.617003:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023507.617015:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000b3c61f7d) 00000020:00000080:0.0:1789023507.617036:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789023507.617040:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789023507.617111:0:6712:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000aecc76e1 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789023507.617118:0:6712:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789023507.617127:0:6712:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3c1fcbfb3417a43 00010000:00010000:0.0:1789023507.623597:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789023507.623917:0:6712:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1789023507.626799:0:6712:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1789023507.627110:0:6712:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789023507.634010:0:6712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789023507.634795:0:6712:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789023507.635936:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789023507.635947:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023507.635951:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023507.635953:0:6712:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789023507.635956:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023507.635959:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023507.635960:0:6712:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789023507.635967:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789023507.635969:0:6712:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789023507.636011:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023507.636014:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023507.636015:0:6712:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789023507.636017:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789023507.641069:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789023507.641109:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789023507.641134:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: 00000000eff1acc1/0xc3c1fcbfb3417a2e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.641148:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: 00000000eff1acc1/0xc3c1fcbfb3417a2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023507.641157:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d089d800 from 1 10000000:01000000:0.0:1789023507.641159:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023507.641199:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417a4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.641207:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417a4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.641217:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417a4a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023507.641474:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802048:0@lo:101: 00000100:00100000:0.0:1789023507.641568:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.641612:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c449bee going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.641725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802048 00000100:00100000:2.0:1789023507.641733:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802048 00000100:00100000:2.0:1789023507.641782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789023507.641791:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003f81d1d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+10:6692:x1875927024802048:12345-0@lo:101: 00010000:00010000:2.0:1789023507.641803:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023507.641825:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000092bb2313/0xc3c1fcbfb3417a51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.641847:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000092bb2313/0xc3c1fcbfb3417a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.641856:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000092bb2313/0xc3c1fcbfb3417a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023507.641863:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000092bb2313, rc 0) 00000100:00100000:2.0:1789023507.641909:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003f81d1d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802048:12345-0@lo:101: Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.641915:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789023507.641985:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bb221f1e pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802048:0@lo:101: 00010000:00010000:1.0:1789023507.642014:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417a4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.642021:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: 00000000467e0471/0xc3c1fcbfb3417a4a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023507.642133:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802176:0@lo:501: 00000100:00100000:1.0:1789023507.642161:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.642186:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025ae6610 going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.642567:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802176 00000100:00100000:2.0:1789023507.642576:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802176 00000100:00100000:2.0:1789023507.642612:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789023507.642619:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fd7847c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802176:12345-0@lo:501: 00000100:00100000:2.0:1789023507.642847:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fd7847c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802176:12345-0@lo:501: Request processed in 229us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.642862:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789023507.642936:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802176:0@lo:501: 00000100:00100000:1.0:1789023507.642967:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802304:0@lo:503: 00000100:00100000:1.0:1789023507.643000:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.643021:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025ae6610 going to sleep for 11 seconds 00000100:00100000:1.0:1789023507.643034:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802304 00000100:00100000:1.0:1789023507.643037:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802304 00000100:00100000:1.0:1789023507.643052:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789023507.643056:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0e0cf64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802304:12345-0@lo:503: 00000100:00100000:1.0:1789023507.643274:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0e0cf64 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802304:12345-0@lo:503: Request processed in 217us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023507.643280:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789023507.643310:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802304:0@lo:503: 00000040:00080000:1.0:1789023507.643682:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023507.643762:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802432:0@lo:502: 00000100:00100000:1.0:1789023507.643801:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.643824:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025ae6610 going to sleep for 11 seconds 00000100:00100000:1.0:1789023507.643845:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802432 00000100:00100000:1.0:1789023507.643855:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802432 00000100:00100000:1.0:1789023507.643873:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023507.643878:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d466732a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802432:12345-0@lo:502: 00000100:00100000:1.0:1789023507.644028:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d466732a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802432:12345-0@lo:502: Request processed in 148us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023507.644035:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023507.644067:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802432:0@lo:502: 00000040:00080000:1.0:1789023507.644519:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789023507.644564:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789023507.644586:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802560:0@lo:502: 00000100:00100000:1.0:1789023507.644623:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.644633:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set 0000000025ae6610 going to sleep for 11 seconds 00000100:00100000:1.0:1789023507.644655:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802560 00000100:00100000:1.0:1789023507.644659:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802560 00000100:00100000:1.0:1789023507.644677:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789023507.644683:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ece8284d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802560:12345-0@lo:502: 00000100:00100000:1.0:1789023507.644798:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ece8284d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802560:12345-0@lo:502: Request processed in 115us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023507.644804:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789023507.644845:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f61553f5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802560:0@lo:502: 00000040:00080000:1.0:1789023507.644915:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789023507.644923:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789023507.653835:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023507.653849:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023507.653851:0:6716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789023507.653857:0:6716:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65d089d800 00000020:00000080:0.0:1789023507.653867:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789023507.653904:0:6716:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023507.653908:0:6716:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023507.653909:0:6716:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789023507.653912:0:6716:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789023507.654050:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789023507.654078:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789023507.654097:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.654119:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023507.654157:0:6692:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789023507.654160:0:6692:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e65d089d800 10000000:01000000:1.0:1789023507.654163:0:6692:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e65d089d800 10000000:01000000:1.0:1789023507.654167:0:6692:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789023507.654172:0:6692:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65d089d800 from 1 10000000:01000000:1.0:1789023507.654174:0:6692:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789023507.654206:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.654214:0:6692:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.654225:0:6692:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023507.654261:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802688:0@lo:101: 00000100:00100000:1.0:1789023507.654333:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.654395:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023507.654588:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802688 00000100:00100000:0.0:1789023507.654596:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802688 00000100:00100000:0.0:1789023507.654634:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789023507.654642:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024802688:12345-0@lo:101: 00010000:00010000:0.0:1789023507.654654:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023507.654669:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.654690:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.654699:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.654707:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05800, rc 0) 00000100:00100000:0.0:1789023507.654743:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024802688:12345-0@lo:101: Request processed in 101us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.654748:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789023507.654843:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802688:0@lo:101: 00010000:00010000:1.0:1789023507.654856:0:6692:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.654865:0:6692:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023507.654962:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802816:0@lo:501: 00000100:00100000:1.0:1789023507.654988:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.655005:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1600 going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.656823:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802816 00000100:00100000:2.0:1789023507.656835:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802816 00000100:00100000:2.0:1789023507.656949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789023507.656960:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024802816:12345-0@lo:501: 00000100:00100000:2.0:1789023507.657263:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024802816:12345-0@lo:501: Request processed in 304us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.657270:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789023507.657360:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802816:0@lo:501: 00000100:00100000:1.0:1789023507.657418:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802944:0@lo:503: 00000100:00100000:1.0:1789023507.657465:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.664134:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023507.666151:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024802944 00000100:00100000:0.0:1789023507.666167:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024802944 00000100:00100000:3.0:1789023507.672213:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789023507.672225:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024802944:12345-0@lo:503: 00000100:00100000:3.0:1789023507.673563:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024802944:12345-0@lo:503: Request processed in 1333us (16091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023507.673574:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789023507.673701:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024802944:0@lo:503: 00000040:00080000:0.0:1789023507.673994:0:6692:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789023507.674065:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024803072:0@lo:502: 00000100:00100000:0.0:1789023507.674115:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.680917:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d32b60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.681036:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803072 00000100:00100000:2.0:1789023507.681046:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803072 00000100:00100000:2.0:1789023507.681087:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789023507.681095:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024803072:12345-0@lo:502: 00000100:00100000:2.0:1789023507.681357:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024803072:12345-0@lo:502: Request processed in 262us (7242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.681517:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024803072:0@lo:502: 00000040:00080000:0.0:1789023507.681804:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789023507.681882:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789023507.681918:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789023507.681962:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789023507.681994:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789023507.682040:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789023507.682075:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789023507.682108:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789023507.682153:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789023507.682187:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789023507.682220:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789023507.682264:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789023507.682299:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789023507.682332:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789023507.682466:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789023507.682633:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789023507.682668:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789023507.682738:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789023507.682775:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789023507.682822:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789023507.682873:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789023507.682904:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789023507.682934:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789023507.682986:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789023507.683018:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789023507.683043:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789023507.683106:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789023507.683140:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1789023507.683182:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024803200:0@lo:502: 00000100:00100000:0.0:1789023507.683246:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.683283:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d32b60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023507.683392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789023507.683440:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803200 00000100:00100000:2.0:1789023507.683447:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803200 00000100:00100000:2.0:1789023507.683492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789023507.683501:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024803200:12345-0@lo:502: 00000100:00100000:2.0:1789023507.683702:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024803200:12345-0@lo:502: Request processed in 202us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.683709:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789023507.684217:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024803200:0@lo:502: 00000040:00080000:0.0:1789023507.684321:0:6692:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789023507.684332:0:6692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789023507.685736:0:6717:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789023507.685755:0:6717:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e65f00419c0) 00000020:00000080:0.0:1789023507.685775:0:6717:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1789023507.685871:0:6717:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65d089d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789023507.685876:0:6717:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65d089d800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789023507.685878:0:6717:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65d089d800 3 00010000:00080000:0.0:1789023507.685907:0:6717:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65dddeb000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789023507.690037:0:6717:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789023507.690289:0:6717:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789023507.690325:0:6717:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789023507.690336:0:6717:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3c1fcbfb3417a6d 00000100:00080000:1.0:1789023507.690346:0:6717:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789023507.690356:0:6717:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e65dddeb000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789023507.690397:0:6717:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65e77e1180 x1875927024803328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789023507.690418:0:6717:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789023507.690656:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875927024803328:0@lo:38: 00000100:00100000:3.0:1789023507.690712:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.690911:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803328 00000100:00100000:0.0:1789023507.690918:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803328 00000100:00100000:0.0:1789023507.690949:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023507.690956:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875927024803328:12345-0@lo:38: 00010000:00080000:0.0:1789023507.690976:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 173 last 0 00000020:00000080:0.0:1789023507.691002:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3c1fcbfb3417a74 00000004:00100000:0.0:1789023507.691013:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789023507.691036:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8e65dddea800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023507.691077:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875927024803328:12345-0@lo:38: Request processed in 121us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.691084:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1789023507.691267:0:6717:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1789023507.691309:0:6692:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1789023507.691329:0:6692:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023507.691340:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.691352:0:6692:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789023507.691406:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789023507.691408:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789023507.691410:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023507.691411:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023507.691412:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023507.691413:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023507.691415:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023507.691416:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789023507.691418:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789023507.691419:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023507.691420:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789023507.691424:0:6692:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789023507.691426:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789023507.691427:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789023507.691428:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023507.691429:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023507.691430:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023507.691431:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023507.691432:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023507.691433:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789023507.691434:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789023507.691436:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023507.691437:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789023507.691452:0:6692:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789023507.691463:0:6692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024803456:0@lo:253: 00000100:00100000:0.0:1789023507.691681:0:6692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.691705:0:6692:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d32b60c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789023507.691989:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e65e77e1180 x1875927024803328/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023517 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023507.692000:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789023507.692007:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789023507.692015:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789023507.692018:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789023507.692021:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65dddeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789023507.692026:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875927024803328:0@lo:38: 00000100:00100000:3.0:1789023507.697525:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803456 00000100:00100000:3.0:1789023507.697544:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803456 00000100:00100000:3.0:1789023507.697603:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789023507.697614:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6692:x1875927024803456:12345-0@lo:253: 20000000:01000000:3.0:1789023507.697646:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789023507.697659:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:3.0:1789023507.725971:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1789023507.729749:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789023507.729769:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789023507.730083:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789023507.730088:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789023507.730111:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730129:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb34179e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730155:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730192:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb34179e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730206:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb34179e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 12 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023507.730219:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875927024803584:0@lo:104: 00000100:00100000:0.0:1789023507.730277:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023507.730321:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d32b6600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023507.730344:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803584 00000100:00100000:0.0:1789023507.730351:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803584 00000100:00100000:0.0:1789023507.730407:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023507.730416:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5861:x1875927024803584:12345-0@lo:104: 00010000:00010000:0.0:1789023507.730428:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730474:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023507.730500:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5861:x1875927024803584:12345-0@lo:104: Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023507.730506:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789023507.730525:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023507.730531:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730538:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c1668800 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023507.730549:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730558:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023507.730564:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023507.730570:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023507.730597:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730603:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023507.730616:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730622:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb34179e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb34179e8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023507.730638:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.730640:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023507.730641:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023507.730665:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875927024803584:0@lo:104: 00010000:00010000:0.0:1789023507.730681:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023507.730911:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024803712:0@lo:103: 00000100:00100000:3.0:1789023507.730947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023507.731206:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803712 00000100:00100000:1.0:1789023507.731211:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803712 00010000:00010000:1.0:1789023507.731230:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb34179e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 13 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023507.731260:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023507.731267:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3313:x1875927024803712:12345-0@lo:103: 00010000:00010000:1.0:1789023507.731277:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023507.731283:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb34179e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 13 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731298:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb34179e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 13 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731311:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb34179e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb34179e1 expref: 13 pid: 5839 timeout: 323 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731325:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731333:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789023507.731345:0:6710:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001836095s 00010000:00010000:1.0:1789023507.731349:0:6710:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731357:0:6710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731374:0:6710:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731381:0:6710:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731387:0:6710:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023507.731391:0:6710:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731398:0:6710:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731419:0:6710:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731428:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023507.731460:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+12:3313:x1875927024803712:12345-0@lo:103: Request processed in 193us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023507.731467:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023507.731541:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024803712:0@lo:103: 00010000:00010000:1.0:1789023507.731559:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731565:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023507.731572:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417a7b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023507.743079:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:6692:x1875927024803456:12345-0@lo:253: Request processed in 45460us (51391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023507.743093:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789023507.743188:0:6692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:6692:1875927024803456:0@lo:253: 10000000:01000000:0.0:1789023507.743204:0:6692:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789023507.743207:0:6692:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023507.743222:0:6692:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789023507.743224:0:6692:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023507.743225:0:6692:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023507.743226:0:6692:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023507.743228:0:6692:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023507.743229:0:6692:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023507.743230:0:6692:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789023507.743232:0:6692:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789023507.743233:0:6692:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023507.743234:0:6692:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789023507.743250:0:6692:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789023507.749274:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789023507.749429:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789023507.749836:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789023507.749977:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789023507.750173:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789023507.750336:0:6692:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789023507.754178:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1789023507.963419:0:6692:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789023507.963426:0:6692:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789023507.963458:0:6692:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789023507.963536:0:6692:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789023507.963550:0:6692:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1789023507.963574:0:6692:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1789023508.755788:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023509.770472:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789023510.155169:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789023510.155175:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65d252c800 from 21 10000000:01000000:3.0:1789023510.155179:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789023510.155222:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.155234:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.155244:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023510.155267:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0073800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024803840:0@lo:101: 00000100:00100000:3.0:1789023510.155334:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.155394:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789023510.155650:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803840 00000100:00100000:0.0:1789023510.155658:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803840 00000100:00100000:0.0:1789023510.155702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789023510.155723:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:5843:x1875927024803840:12345-0@lo:101: 00010000:00010000:0.0:1789023510.155736:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023510.155748:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a82 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023510.155771:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023510.155781:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023510.155799:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04400, rc 0) 00000100:00100000:0.0:1789023510.155850:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024803840:12345-0@lo:101: Request processed in 139us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023510.155857:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789023510.155899:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0073800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024803840:0@lo:101: 00010000:00010000:0.0:1789023510.155914:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023510.155934:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023510.155986:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024803968:0@lo:501: 00000100:00100000:0.0:1789023510.156011:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.156032:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f0140b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023510.156044:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024803968 00000100:00100000:0.0:1789023510.156048:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024803968 00000100:00100000:0.0:1789023510.156067:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789023510.156073:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024803968:12345-0@lo:501: 00000100:00100000:0.0:1789023510.156401:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024803968:12345-0@lo:501: Request processed in 326us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023510.156407:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789023510.156468:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024803968:0@lo:501: 00000100:00100000:2.0:1789023510.156523:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804096:0@lo:503: 00000100:00100000:2.0:1789023510.156562:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023510.156586:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4232d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023510.158072:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804096 00000100:00100000:0.0:1789023510.158085:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804096 00000100:00100000:0.0:1789023510.158130:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789023510.158139:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024804096:12345-0@lo:503: 00000100:00100000:0.0:1789023510.158500:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024804096:12345-0@lo:503: Request processed in 338us (1913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023510.158509:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789023510.159683:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804096:0@lo:503: 00000100:00100000:2.0:1789023510.161261:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6841:1875927024804224:0@lo:502: 00000100:00100000:2.0:1789023510.161322:0:6841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023510.161356:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804224 00000100:00100000:2.0:1789023510.161363:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804224 00000100:00100000:2.0:1789023510.161399:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789023510.161407:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6841:x1875927024804224:12345-0@lo:502: 00000100:00100000:2.0:1789023510.163255:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6841:x1875927024804224:12345-0@lo:502: Request processed in 1842us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023510.163270:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789023510.163340:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4232d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023510.163362:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6841:1875927024804224:0@lo:502: 00000100:00100000:2.0:1789023510.163423:0:6841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6841:1875927024804352:0@lo:502: 00000100:00100000:2.0:1789023510.163462:0:6841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023510.163505:0:6841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4232d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.166045:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804352 00000100:00100000:3.0:1789023510.166057:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804352 00000100:00100000:3.0:1789023510.166099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789023510.166109:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6841:x1875927024804352:12345-0@lo:502: 00000100:00100000:3.0:1789023510.166356:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:6841:x1875927024804352:12345-0@lo:502: Request processed in 248us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.166364:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789023510.166636:0:6841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6841:1875927024804352:0@lo:502: 00000040:00080000:2.0:1789023510.166669:0:6841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1789023510.166993:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1789023510.167012:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789023510.167021:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.167032:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023510.167047:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789023510.167049:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65d252c800 from 4 10000000:01000000:3.0:1789023510.167052:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789023510.167082:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.167089:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.167099:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023510.167118:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804480:0@lo:101: 00000100:00100000:3.0:1789023510.167154:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.167192:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f2780 going to sleep for 11 seconds 00000100:00100000:2.0:1789023510.167237:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804480 00000100:00100000:2.0:1789023510.167242:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804480 00000100:00100000:2.0:1789023510.167274:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789023510.167282:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024804480:12345-0@lo:101: 00010000:00010000:2.0:1789023510.167291:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023510.167309:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a90 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.167330:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.167341:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.167832:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fc400, rc 0) 00000100:00100000:2.0:1789023510.167875:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024804480:12345-0@lo:101: Request processed in 593us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023510.167881:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789023510.167919:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804480:0@lo:101: 00010000:00010000:2.0:1789023510.168444:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.168455:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023510.168533:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804608:0@lo:256: 00000100:00100000:2.0:1789023510.168568:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023510.168598:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f42320c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.168661:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804608 00000100:00100000:3.0:1789023510.168666:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804608 00000100:00100000:3.0:1789023510.168702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789023510.168799:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024804608:12345-0@lo:256: 20000000:01000000:3.0:1789023510.168819:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789023510.168833:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789023510.168836:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789023510.169987:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024804608:12345-0@lo:256: Request processed in 1272us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.169997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789023510.172399:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804608:0@lo:256: 10000000:01000000:1.0:1789023510.172458:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789023510.172468:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023510.172521:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023510.172531:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789023510.172534:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1789023510.172537:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789023510.172571:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023510.172579:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023510.172589:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023510.172608:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804736:0@lo:101: 00000100:00100000:1.0:1789023510.172660:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023510.172702:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d72c1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.173080:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804736 00000100:00100000:3.0:1789023510.173087:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804736 00000100:00100000:3.0:1789023510.173139:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789023510.173154:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024804736:12345-0@lo:101: 00010000:00010000:3.0:1789023510.173166:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023510.173179:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417a9e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.173198:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.173207:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.173213:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e6602166200, rc 0) 00000100:00100000:3.0:1789023510.173254:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024804736:12345-0@lo:101: Request processed in 101us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.173260:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789023510.173900:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804736:0@lo:101: 00010000:00010000:0.0:1789023510.173916:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023510.173926:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023510.173996:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804864:0@lo:501: 00000100:00100000:0.0:1789023510.174029:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.174062:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.174601:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804864 00000100:00100000:3.0:1789023510.174609:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804864 00000100:00100000:3.0:1789023510.174662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789023510.174671:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024804864:12345-0@lo:501: 00000100:00100000:3.0:1789023510.174927:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024804864:12345-0@lo:501: Request processed in 256us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.174934:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789023510.175186:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804864:0@lo:501: 00000100:00100000:0.0:1789023510.175221:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804992:0@lo:503: 00000100:00100000:0.0:1789023510.175263:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.175299:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.176072:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024804992 00000100:00100000:3.0:1789023510.176081:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024804992 00000100:00100000:3.0:1789023510.176122:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789023510.176132:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024804992:12345-0@lo:503: 00000100:00100000:3.0:1789023510.176456:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024804992:12345-0@lo:503: Request processed in 325us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.176472:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789023510.177555:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024804992:0@lo:503: 00000100:00100000:0.0:1789023510.178783:0:6843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6843:1875927024805120:0@lo:502: 00000100:00100000:0.0:1789023510.178861:0:6843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.178904:0:6843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789023510.179065:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024805120 00000100:00100000:2.0:1789023510.179072:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024805120 00000100:00100000:2.0:1789023510.179120:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789023510.179130:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:6843:x1875927024805120:12345-0@lo:502: 00000100:00100000:2.0:1789023510.179404:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:6843:x1875927024805120:12345-0@lo:502: Request processed in 275us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023510.179421:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789023510.179452:0:6843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6843:1875927024805120:0@lo:502: 00000020:01000000:1.0:1789023510.179504:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789023510.179512:0:6843:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789023510.179518:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023510.179520:0:6843:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789023510.179525:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789023510.179529:0:6843:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:1.0:1789023510.179548:0:6843:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789023510.179550:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789023510.179564:0:6843:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e65d2723380) 00000020:00000080:1.0:1789023510.179588:0:6843:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1789023510.179593:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789023510.179658:0:6843:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789023510.179664:0:6843:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789023510.179672:0:6843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3417ab3 00010000:00080000:1.0:1789023510.179700:0:6843:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e64c13a7000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789023510.180052:0:6843:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789023510.255560:0:6843:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789023510.255581:0:6843:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789023510.256335:0:6843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023510.257208:0:6843:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023510.257260:0:6843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789023510.257317:0:6843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1789023510.259297:0:6846:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789023510.259305:0:6846:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789023510.260822:0:6843:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789023510.260836:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789023510.260868:0:6843:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789023510.260889:0:6843:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3417aba 00000100:00080000:3.0:1789023510.260899:0:6843:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023510.260911:0:6843:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e64c13a7000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789023510.261073:0:6843:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65d0073100 x1875927024805248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023510.261100:0:6843:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789023510.261150:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024805248:0@lo:8: 00000020:01000000:3.0:1789023510.261157:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023510.261161:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023510.261163:0:6843:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789023510.261165:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023510.261169:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023510.261170:0:6843:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789023510.261173:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023510.261175:0:6843:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789023510.261197:0:6843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6843:1875927024805376:0@lo:502: 00000100:00100000:2.0:1789023510.261215:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.261238:0:6843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.261255:0:6843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.261274:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024805376 00000100:00100000:3.0:1789023510.261280:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024805376 00000100:00100000:3.0:1789023510.261319:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789023510.261328:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:6843:x1875927024805376:12345-0@lo:502: 00000100:00100000:3.0:1789023510.261667:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:6843:x1875927024805376:12345-0@lo:502: Request processed in 339us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.261680:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789023510.261752:0:6843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6843:1875927024805376:0@lo:502: 00000020:01000000:2.0:1789023510.261777:0:6843:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023510.261783:0:6843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023510.261784:0:6843:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789023510.261788:0:6843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789023510.261908:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789023510.261922:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789023510.261932:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.261942:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023510.261951:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789023510.261953:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d252c800 from 1 10000000:01000000:2.0:1789023510.261955:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789023510.261979:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.261987:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.261996:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023510.262009:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024805504:0@lo:101: 00000100:00100000:2.0:1789023510.262043:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023510.262068:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4232300 going to sleep for 11 seconds 00000100:00100000:0.0:1789023510.262220:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024805248 00000100:00100000:0.0:1789023510.262228:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024805248 00000100:00100000:0.0:1789023510.262257:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023510.262263:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875927024805248:12345-0@lo:8: 00010000:00080000:0.0:1789023510.262283:0:6694:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:0.0:1789023510.262308:0:6694:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3417ac8 00002000:00100000:0.0:1789023510.262339:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e65d0908000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789023510.262363:0:6694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789023510.262366:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789023510.262470:0:6694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789023510.262630:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789023510.262653:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8e65d090d000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023510.262704:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875927024805248:12345-0@lo:8: Request processed in 439us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023510.262719:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789023510.262737:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0073100 x1875927024805248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023510.262747:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789023510.262754:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789023510.262761:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789023510.262766:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789023510.262768:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e64c13a7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789023510.262778:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789023510.262783:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024805248:0@lo:8: 00000100:00100000:0.0:1789023510.262865:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024805632:0@lo:400: 00000100:00100000:0.0:1789023510.262894:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.262914:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023510.262919:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024805760:0@lo:400: 00000100:00100000:0.0:1789023510.262943:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.262977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024805632 00000100:00100000:0.0:1789023510.262982:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024805632 00000100:00100000:0.0:1789023510.263005:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024805760 00000100:00100000:0.0:1789023510.263008:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024805760 00000100:00100000:0.0:1789023510.263027:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023510.263032:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024805632:12345-0@lo:400: 00000100:00100000:0.0:1789023510.263067:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024805632:12345-0@lo:400: Request processed in 34us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023510.263073:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023510.263083:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023510.263089:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024805760:12345-0@lo:400: 00000100:00100000:0.0:1789023510.263114:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024805760:12345-0@lo:400: Request processed in 25us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023510.263119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789023510.263147:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789023510.263167:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f40ead80 x1875927024805760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023510.263178:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024805760:0@lo:400: 00010000:00080000:0.0:1789023510.263189:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f40ea680 x1875927024805632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023526 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023510.263196:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40ea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024805632:0@lo:400: 00000100:00100000:3.0:1789023510.264212:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024805504 00000100:00100000:3.0:1789023510.264222:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024805504 00000100:00100000:3.0:1789023510.264257:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789023510.264265:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024805504:12345-0@lo:101: 00010000:00010000:3.0:1789023510.264277:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023510.264292:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417ac1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.264314:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.264324:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.264331:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e6602166c00, rc 0) 00000100:00100000:3.0:1789023510.264441:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024805504:12345-0@lo:101: Request processed in 176us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.264449:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789023510.266646:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024805504:0@lo:101: 00010000:00010000:3.0:1789023510.266673:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.266685:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023510.268733:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024805888:0@lo:501: 00000100:00100000:3.0:1789023510.268810:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.269056:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f2cc0 going to sleep for 11 seconds 00000004:00080000:3.0:1789023510.269075:0:6846:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789023510.269327:0:6846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 176339848868ns, next at 0ns, rc = 0 00000100:00100000:2.0:1789023510.273544:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024805888 00000100:00100000:2.0:1789023510.273558:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024805888 00000100:00100000:3.0:1789023510.274071:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789023510.274081:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024805888:12345-0@lo:501: 00000100:00100000:3.0:1789023510.274329:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024805888:12345-0@lo:501: Request processed in 248us (5517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.274335:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789023510.274397:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024805888:0@lo:501: 00000100:00100000:3.0:1789023510.274443:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024806016:0@lo:503: 00000100:00100000:3.0:1789023510.274510:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.274540:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.274554:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806016 00000100:00100000:3.0:1789023510.274559:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806016 00000100:00100000:3.0:1789023510.274579:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789023510.274584:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024806016:12345-0@lo:503: 00000100:00100000:3.0:1789023510.274847:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024806016:12345-0@lo:503: Request processed in 262us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.274854:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789023510.274891:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024806016:0@lo:503: 00000100:00100000:0.0:1789023510.276435:0:6850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6850:1875927024806144:0@lo:502: 00000100:00100000:0.0:1789023510.279956:0:6850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.280009:0:6850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.280063:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806144 00000100:00100000:3.0:1789023510.280072:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806144 00000100:00100000:3.0:1789023510.280123:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789023510.280133:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:6850:x1875927024806144:12345-0@lo:502: 00000100:00100000:3.0:1789023510.280393:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:6850:x1875927024806144:12345-0@lo:502: Request processed in 261us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.280411:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789023510.282283:0:6850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6850:1875927024806144:0@lo:502: 00000020:01000000:0.0:1789023510.282320:0:6850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023510.282329:0:6850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023510.282331:0:6850:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789023510.282339:0:6850:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65d252c800 00000020:00000080:0.0:1789023510.282342:0:6850:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789023510.282385:0:6850:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6850:1875927024806272:0@lo:502: 00000100:00100000:0.0:1789023510.282437:0:6850:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023510.282469:0:6850:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.282610:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806272 00000100:00100000:3.0:1789023510.282616:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806272 00000100:00100000:3.0:1789023510.282650:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789023510.282657:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:6850:x1875927024806272:12345-0@lo:502: 00000100:00100000:3.0:1789023510.282835:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:6850:x1875927024806272:12345-0@lo:502: Request processed in 177us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.282842:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789023510.282881:0:6850:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40ea680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:6850:1875927024806272:0@lo:502: 00000020:01000000:3.0:1789023510.282898:0:6850:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023510.282903:0:6850:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023510.282904:0:6850:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789023510.282908:0:6850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789023510.282964:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789023510.282983:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789023510.282991:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.283003:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023510.283011:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789023510.283014:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e65d2720000 from 1 10000000:01000000:3.0:1789023510.283016:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789023510.283037:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.283044:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.283060:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023510.283072:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024806400:0@lo:101: 00000100:00100000:3.0:1789023510.283095:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.283114:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4128000 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.283125:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806400 00000100:00100000:3.0:1789023510.283129:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806400 00000100:00100000:3.0:1789023510.283146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789023510.283152:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024806400:12345-0@lo:101: 00010000:00010000:3.0:1789023510.283159:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023510.283169:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417ad6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.283189:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.283200:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.283208:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e6602167c00, rc 0) 00000100:00100000:3.0:1789023510.283230:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024806400:12345-0@lo:101: Request processed in 79us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.283236:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789023510.283259:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024806400:0@lo:101: 00010000:00010000:3.0:1789023510.283269:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023510.283287:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023510.283322:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024806528:0@lo:501: 00000100:00100000:3.0:1789023510.283342:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.283956:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4128000 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.283972:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806528 00000100:00100000:3.0:1789023510.283976:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806528 00000100:00100000:3.0:1789023510.284015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789023510.284022:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024806528:12345-0@lo:501: 00000100:00100000:3.0:1789023510.284208:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024806528:12345-0@lo:501: Request processed in 186us (864us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789023510.284214:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789023510.284395:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024806528:0@lo:501: 10000000:01000000:2.0:1789023510.284426:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789023510.284433:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023510.284441:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023510.323056:0:6848:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789023510.323088:0:6848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024806784:0@lo:7: 00000100:00100000:2.0:1789023510.323147:0:6848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023510.323194:0:6848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4232b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789023510.323213:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024806656:0@lo:13: 00000100:00100000:2.0:1789023510.323236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023510.326367:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806784 00000100:00100000:1.0:1789023510.326383:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806784 00000100:00100000:1.0:1789023510.326454:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023510.326465:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6848:x1875927024806784:12345-0@lo:7: 00000100:00080000:3.0:1789023510.330010:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023510.330521:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806656 00000100:00100000:1.0:1789023510.330533:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806656 00000100:00100000:1.0:1789023510.330578:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023510.330588:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875927024806656:12345-0@lo:13: 00002000:00000024:1.0:1789023510.330615:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1789023510.330848:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875927024806656:12345-0@lo:13: Request processed in 262us (7610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023510.330856:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789023510.331495:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d2783800 x1875927024806656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023526 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023510.331516:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024806656:0@lo:13: 00002000:00080000:1.0:1789023510.332251:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1789023510.332258:0:6696:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789023510.332505:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6848:x1875927024806784:12345-0@lo:7: Request processed in 6040us (9355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023510.332515:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789023510.332745:0:6848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d2781880 x1875927024806784/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789023526 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023510.332758:0:6848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024806784:0@lo:7: 00000004:00080000:3.0:1789023510.332770:0:6848:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789023510.332815:0:6848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024806912:0@lo:5: 00000100:00100000:3.0:1789023510.332851:0:6848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.332900:0:6848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c7ec60c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023510.332980:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024806912 00000100:00100000:1.0:1789023510.332987:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024806912 00000100:00100000:1.0:1789023510.333028:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023510.333037:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6848:x1875927024806912:12345-0@lo:5: 00002000:00080000:1.0:1789023510.333058:0:6694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789023510.333060:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789023510.333266:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6848:x1875927024806912:12345-0@lo:5: Request processed in 230us (415us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789023510.333272:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789023510.333441:0:6848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0070700 x1875927024806912/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023526 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023510.333461:0:6848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024806912:0@lo:5: 00000004:00080000:3.0:1789023510.333471:0:6848:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789023510.333524:0:6848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024807040:0@lo:700: 00000100:00100000:3.0:1789023510.333548:0:6848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.333561:0:6848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c7ec60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023510.333622:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807040 00000100:00100000:2.0:1789023510.333627:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807040 00000100:00100000:2.0:1789023510.333657:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023510.333675:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6848:x1875927024807040:12345-0@lo:700: 00000100:00100000:2.0:1789023510.333703:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6702:1875927024807168:0@lo:700: 00000100:00100000:2.0:1789023510.333733:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023510.333758:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f4232840 going to sleep for 11 seconds 00000100:00100000:3.0:1789023510.333882:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807168 00000100:00100000:3.0:1789023510.333886:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807168 00000100:00100000:3.0:1789023510.333922:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023510.333929:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6702:x1875927024807168:12345-0@lo:700: 00000004:00080000:2.0:1789023510.353342:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:3.0:1789023510.464372:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1789023510.472333:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6702:x1875927024807168:12345-0@lo:700: Request processed in 138397us (138591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.472357:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789023510.475168:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d2782a00 x1875927024807168/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789023526 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023510.475186:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6702:1875927024807168:0@lo:700: 40000000:02000000:2.0:1789023510.475200:0:6702:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1789023510.598313:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789023510.598333:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1789023510.598767:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6848:x1875927024807040:12345-0@lo:700: Request processed in 265090us (265214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023510.598784:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789023510.598914:0:6848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0073100 x1875927024807040/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789023526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023510.598925:0:6848:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789023510.598940:0:6848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024807040:0@lo:700: 00000004:02000040:0.0:1789023510.639210:0:6848:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789023510.647821:0:6848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024807296:0@lo:5: 00000100:00100000:3.0:1789023510.647884:0:6848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023510.647936:0:6848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c4c9a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789023510.648067:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807296 00000100:00100000:0.0:1789023510.648080:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807296 00000100:00100000:0.0:1789023510.648143:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023510.648152:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6848:x1875927024807296:12345-0@lo:5: 00002000:00080000:3.0:1789023510.654712:0:6696:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789023510.654732:0:6696:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789023510.664421:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6848:x1875927024807296:12345-0@lo:5: Request processed in 16259us (16526us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789023510.664439:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789023510.666858:0:6848:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0071880 x1875927024807296/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023526 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023510.666879:0:6848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6848:1875927024807296:0@lo:5: 00000004:00080000:0.0:1789023510.666893:0:6848:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1789023510.796281:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023511.819214:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023512.841672:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023513.868697:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789023513.963168:0:7066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789023514.891998:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023515.660579:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024807808:0@lo:400: 00000100:00100000:3.0:1789023515.660657:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023515.660717:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023515.660725:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024807424:0@lo:400: 00000100:00100000:3.0:1789023515.660769:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023515.660801:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024807552:0@lo:400: 00000100:00100000:3.0:1789023515.660828:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023515.660849:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023515.660856:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024807680:0@lo:400: 00000100:00100000:3.0:1789023515.660881:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023515.660913:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807424 00000100:00100000:3.0:1789023515.660921:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807424 00000100:00100000:3.0:1789023515.660964:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789023515.661524:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3312:x1875927024807424:12345-0@lo:400: 00000100:00100000:3.0:1789023515.661587:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3312:x1875927024807424:12345-0@lo:400: Request processed in 141us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023515.661595:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789023515.661635:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807552 00000100:00100000:3.0:1789023515.661639:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807552 00000100:00100000:3.0:1789023515.661669:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807680 00000100:00100000:3.0:1789023515.661672:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807680 00000100:00100000:3.0:1789023515.661696:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023515.661702:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024807552:12345-0@lo:400: 00000100:00100000:3.0:1789023515.661739:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024807552:12345-0@lo:400: Request processed in 37us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023515.661745:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023515.663179:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024807936:0@lo:13: 00000100:00100000:1.0:1789023515.663238:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789023515.663253:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023515.663276:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023515.663289:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024807680:12345-0@lo:400: 00000100:00100000:1.0:1789023515.663291:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807936 00000100:00100000:1.0:1789023515.663296:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807936 00000100:00100000:1.0:1789023515.663333:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023515.663333:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024807680:12345-0@lo:400: Request processed in 50us (2451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023515.663339:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875927024807936:12345-0@lo:13: 00000100:00100000:0.0:1789023515.663339:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00002000:00000024:1.0:1789023515.663364:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023515.663381:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024807424:0@lo:400: 00000100:00100000:1.0:1789023515.663397:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875927024807936:12345-0@lo:13: Request processed in 59us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023515.663403:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789023515.663410:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789023515.663428:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f40ead80 x1875927024807936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023531 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023515.663443:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024807936:0@lo:13: 00000100:00100000:0.0:1789023515.663445:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024807808 00000100:00100000:0.0:1789023515.663448:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024807808 00000100:00100000:0.0:1789023515.663489:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023515.663495:0:6694:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789023515.663496:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875927024807808:12345-0@lo:400: 00000100:00100000:1.0:1789023515.663501:0:6694:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789023515.663530:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875927024807808:12345-0@lo:400: Request processed in 35us (2874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023515.663536:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789023515.664128:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0071f80 x1875927024807808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023515.664150:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024807808:0@lo:400: 00010000:00080000:1.0:1789023515.669724:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0072680 x1875927024807680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023515.669748:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024807680:0@lo:400: 00010000:00080000:1.0:1789023515.669779:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0072300 x1875927024807552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023531 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023515.669787:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024807552:0@lo:400: 00000001:00080000:1.0:1789023515.742247:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789023515.913709:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023516.939452:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023517.964068:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023518.985597:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023520.009739:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023520.777622:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023520.777646:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024808064:0@lo:13: 00000100:00100000:1.0:1789023520.777709:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023520.777783:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808064 00000100:00100000:1.0:1789023520.777801:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808064 00000100:00100000:1.0:1789023520.777853:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023520.777862:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024808064:12345-0@lo:13: 00002000:00000024:1.0:1789023520.777893:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023520.777936:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024808064:12345-0@lo:13: Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023520.777943:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789023520.777963:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789023520.777990:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65e77e0000 x1875927024808064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023536 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023520.778000:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789023520.778017:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024808064:0@lo:13: 00000100:00100000:1.0:1789023520.780934:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023520.780957:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024808192:0@lo:400: 00000100:00100000:1.0:1789023520.781109:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023520.781231:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024808320:0@lo:400: 00000100:00100000:1.0:1789023520.781272:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023520.781469:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023520.781512:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024808448:0@lo:400: 00000100:00100000:1.0:1789023520.781541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023520.784199:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808192 00000100:00100000:1.0:1789023520.784213:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808192 00000100:00100000:1.0:1789023520.784278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789023520.784287:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3310:x1875927024808192:12345-0@lo:400: 00000100:00100000:1.0:1789023520.784364:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3310:x1875927024808192:12345-0@lo:400: Request processed in 79us (3257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023520.784372:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789023520.784408:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808320 00000100:00100000:1.0:1789023520.784412:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808320 00000100:00100000:1.0:1789023520.784440:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808448 00000100:00100000:1.0:1789023520.784443:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808448 00000100:00100000:1.0:1789023520.784467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023520.784473:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024808320:12345-0@lo:400: 00000100:00100000:1.0:1789023520.784522:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024808320:12345-0@lo:400: Request processed in 49us (3250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023520.784528:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023520.784538:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023520.784544:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024808448:12345-0@lo:400: 00000100:00100000:1.0:1789023520.784567:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024808448:12345-0@lo:400: Request processed in 24us (3026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023520.784572:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789023520.784591:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023520.784644:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65e77e0380 x1875927024808448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023520.784659:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024808448:0@lo:400: 00010000:00080000:1.0:1789023520.784670:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65e77e3480 x1875927024808320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023520.784678:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024808320:0@lo:400: 00000100:00100000:1.0:1789023520.784710:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024808192:0@lo:400: 00010000:00010000:2.0:1789023521.036212:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023522.062119:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023523.081787:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023524.106453:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789023524.368026:0:7637:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789023524.368030:0:7637:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789023524.368170:0:7637:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e65fc5ee000 00000020:01000004:3.0:1789023524.368199:0:7637:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789023524.368211:0:7637:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789023524.368225:0:7637:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e65c85a19c0) 00000020:00000080:3.0:1789023524.368240:0:7637:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789023524.390121:0:7637:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789023524.390672:0:7637:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789023524.417092:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789023524.425398:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789023524.425434:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789023524.425913:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789023524.426432:0:7637:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1789023524.427071:0:7637:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1789023524.427082:0:7637:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789023524.427092:0:7637:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3c1fcbfb3417aeb 00000020:01000004:1.0:1789023524.427100:0:7637:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1789023524.427121:0:7637:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789023524.427124:0:7637:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789023524.427129:0:7637:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1789023524.427149:0:7637:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1789023524.427153:0:7637:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789023524.450993:0:7637:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789023524.451029:0:7637:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1789023524.451033:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789023524.451035:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789023524.451037:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023524.451039:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023524.451040:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023524.451041:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023524.451043:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023524.451048:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023524.451049:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023524.451050:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023524.451052:0:7637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789023524.451055:0:7637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1789023524.451057:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789023524.451058:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789023524.451059:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023524.451060:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023524.451061:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023524.451062:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023524.451063:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023524.451064:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789023524.451065:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789023524.451066:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023524.451067:0:7637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789023524.451099:0:7637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789023524.451117:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024808576:0@lo:253: 00000100:00100000:1.0:1789023524.451181:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023524.451422:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c4c9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023524.451529:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808576 00000100:00100000:0.0:1789023524.451538:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808576 00000100:00100000:0.0:1789023524.451584:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023524.451593:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:7637:x1875927024808576:12345-0@lo:253: 20000000:01000000:0.0:1789023524.451644:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789023524.451648:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789023524.451653:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789023524.451655:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789023524.453090:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023524.453462:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789023524.453665:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789023524.453789:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789023524.453798:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789023524.453906:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789023524.453965:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789023524.454673:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789023524.454771:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:0.0:1789023524.454774:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:0.0:1789023524.454814:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789023524.454822:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789023524.454963:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789023524.454973:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:0.0:1789023524.455005:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789023524.455014:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789023524.455045:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789023524.455104:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789023524.456558:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789023524.456583:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.148@tcp 20000000:01000000:0.0:1789023524.456585:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.148@tcp (null) (null) (null) 00000040:00080000:0.0:1789023524.456780:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789023524.456790:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789023524.456825:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789023524.456902:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.148@tcp (null) (null) 00000040:00080000:0.0:1789023524.456937:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789023524.456946:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789023524.456990:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789023524.457047:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789023524.457065:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789023524.457068:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789023524.457074:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789023524.457075:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789023524.457078:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789023524.457089:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789023524.457092:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789023524.457128:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789023524.457130:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789023524.458168:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789023524.458369:0:7639:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789023524.458428:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789023524.459063:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789023524.459103:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789023524.459166:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789023524.459180:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789023524.459182:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789023524.460472:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789023524.461146:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789023524.461317:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789023524.461432:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1789023524.461447:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789023524.461450:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789023524.462141:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1789023524.462201:0:7641:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1789023524.462382:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789023524.462955:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1789023524.462999:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1789023524.463031:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1789023524.463045:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789023524.463047:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789023524.464071:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1789023524.464151:0:7642:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1789023524.464318:0:7642:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1789023524.464953:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1789023524.464994:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1789023524.465053:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1789023524.465074:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789023524.465093:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465112:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e6602166e00/0xc3c1fcbfb3417a35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465133:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465141:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465148:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465156:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465163:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465327:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465342:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.465357:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024808704:0@lo:104: 00000100:00100000:3.0:1789023524.465418:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023524.465474:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465509:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.465519:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024808832:0@lo:104: 00010000:00010000:3.0:1789023524.465550:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465558:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 16 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.465567:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024808960:0@lo:104: 00010000:00010000:3.0:1789023524.465584:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.465591:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 16 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.465784:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789023524.465803:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.465896:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.465909:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808704 00000100:00100000:0.0:1789023524.465916:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808704 00000100:00100000:0.0:1789023524.465948:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808832 00000100:00100000:0.0:1789023524.465951:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808832 00000100:00100000:0.0:1789023524.465960:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024808960 00000100:00100000:0.0:1789023524.465962:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024808960 00000100:00100000:0.0:1789023524.465974:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789023524.465983:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d29de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+5:5839:x1875927024808704:12345-0@lo:104: 00010000:00010000:0.0:1789023524.465996:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.466049:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023524.466055:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d29de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+5:5839:x1875927024808704:12345-0@lo:104: Request processed in 74us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023524.466062:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789023524.466099:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789023524.466105:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+4:5839:x1875927024808832:12345-0@lo:104: 00010000:00010000:0.0:1789023524.466113:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.466146:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789023524.466151:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+4:5839:x1875927024808832:12345-0@lo:104: Request processed in 47us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023524.466156:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789023524.466167:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023524.466172:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5839:x1875927024808960:12345-0@lo:104: 00010000:00010000:0.0:1789023524.466188:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.466329:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024809088:0@lo:104: 00000100:00100000:3.0:1789023524.466356:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023524.466385:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e6602166e00/0xc3c1fcbfb3417a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.466394:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e6602166e00/0xc3c1fcbfb3417a35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 16 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.466402:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024809216:0@lo:104: 00000100:00100000:3.0:1789023524.466420:0:5839:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023524.466431:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.466449:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024808704:0@lo:104: 00000100:00100000:3.0:1789023524.466456:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024808832:0@lo:104: 00010000:00010000:3.0:1789023524.466527:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789023524.466533:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.466549:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e6602167800 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023524.466553:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.466562:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023524.466569:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023524.466574:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789023524.466779:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789023524.466787:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1789023524.466974:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809088 00000100:00100000:1.0:1789023524.466979:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809088 00000100:00100000:1.0:1789023524.467013:0:5829:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789023524.467019:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809216 00000100:00100000:1.0:1789023524.467021:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809216 00000100:00100000:1.0:1789023524.467085:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023524.467092:0:7643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+5:5839:x1875927024809088:12345-0@lo:104: 00010000:00010000:1.0:1789023524.467100:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.467144:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789023524.467150:0:7643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+5:5839:x1875927024809088:12345-0@lo:104: Request processed in 59us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.467166:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023524.467180:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023524.467185:0:7643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+4:5839:x1875927024809216:12345-0@lo:104: 00010000:00010000:2.0:1789023524.467347:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023524.467455:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023524.467462:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.467469:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c1668400 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:2.0:1789023524.467472:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.467512:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023524.467519:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023524.467524:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789023524.467545:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.467551:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789023524.467567:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.467575:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668400/0xc3c1fcbfb3417a9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417aa5 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.467587:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023524.467588:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023524.467590:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.467694:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.467898:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023524.467905:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.467912:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e6602167800/0xc3c1fcbfb3417ad6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417add expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.467924:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.467925:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.467927:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023524.467962:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024809088:0@lo:104: 00010000:00010000:0.0:1789023524.468018:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023524.468027:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+4:5839:x1875927024808960:12345-0@lo:104: Request processed in 1853us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023524.468036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789023524.468056:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023524.468060:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.468066:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e6602167e00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023524.468069:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.468075:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023524.468081:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023524.468086:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023524.468106:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.468112:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023524.468126:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.468132:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e6602167e00/0xc3c1fcbfb3417a82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a89 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.468149:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023524.468151:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023524.468153:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023524.468170:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024809600:0@lo:103: 00010000:00010000:1.0:1789023524.468352:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023524.468389:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024809344:0@lo:103: 00010000:00010000:1.0:1789023524.468591:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023524.468609:0:7643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5839:x1875927024809216:12345-0@lo:104: Request processed in 1412us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.468615:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789023524.468836:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023524.468877:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023524.468884:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024809472:0@lo:103: 00000100:00100000:2.0:1789023524.468904:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023524.469059:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809344 00000100:00100000:1.0:1789023524.469066:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809344 00010000:00010000:1.0:1789023524.469088:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 17 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023524.469116:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809472 00000100:00100000:1.0:1789023524.469119:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809472 00010000:00010000:1.0:1789023524.469130:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023524.469148:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023524.469154:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:3310:x1875927024809344:12345-0@lo:103: 00010000:00010000:1.0:1789023524.469165:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023524.469171:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.469179:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.469216:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e6602166200/0xc3c1fcbfb3417aa5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a9e expref: 18 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.469231:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023524.469273:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:3310:x1875927024809344:12345-0@lo:103: Request processed in 119us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.469280:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023524.469293:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023524.469299:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3310:x1875927024809472:12345-0@lo:103: 00010000:00010000:1.0:1789023524.469306:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023524.469311:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.469321:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.469331:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e6602167c00/0xc3c1fcbfb3417add lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ad6 expref: 16 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.469340:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023524.469360:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:3310:x1875927024809472:12345-0@lo:103: Request processed in 61us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.469365:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023524.469397:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024809472:0@lo:103: 00000100:00100000:1.0:1789023524.469406:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024809344:0@lo:103: 00000100:00100000:3.0:1789023524.469957:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024808960:0@lo:104: 00010000:00010000:3.0:1789023524.469969:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023524.469975:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.469991:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fca00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023524.469995:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.470003:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023524.470010:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023524.470015:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023524.470085:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.470093:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023524.470102:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.470109:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417a2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a35 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.470118:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.470120:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.470122:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023524.470141:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5839:1875927024809216:0@lo:104: 00010000:00010000:3.0:1789023524.470165:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.470406:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.470453:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.470455:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023524.470508:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.470516:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c1668e00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:2.0:1789023524.470525:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.470533:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023524.470540:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023524.470546:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789023524.470752:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.470800:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023524.470809:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024809728:0@lo:103: 00000100:00100000:3.0:1789023524.470962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809600 00000100:00100000:3.0:1789023524.470969:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809600 00010000:00010000:3.0:1789023524.470992:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 15 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.471016:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789023524.471024:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:3312:x1875927024809600:12345-0@lo:103: 00010000:00010000:3.0:1789023524.471034:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023524.471039:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 15 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.471049:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 15 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.471063:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3417a89 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a82 expref: 15 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.471074:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023524.471108:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:3312:x1875927024809600:12345-0@lo:103: Request processed in 84us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.471114:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023524.471166:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.471211:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024809600:0@lo:103: 00000100:00100000:3.0:1789023524.471276:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809728 00000100:00100000:3.0:1789023524.471280:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809728 00010000:00010000:3.0:1789023524.471295:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e6602166e00/0xc3c1fcbfb3417a35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 14 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.471322:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789023524.471328:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:3312:x1875927024809728:12345-0@lo:103: 00010000:00010000:3.0:1789023524.471345:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023524.471350:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e6602166e00/0xc3c1fcbfb3417a35 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 14 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.471357:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e6602166e00/0xc3c1fcbfb3417a35 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 14 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.471366:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e6602166e00/0xc3c1fcbfb3417a35 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a2e expref: 14 pid: 5839 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.471374:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023524.471400:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3312:x1875927024809728:12345-0@lo:103: Request processed in 73us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.471406:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789023524.471729:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024809728:0@lo:103: 00010000:00010000:3.0:1789023524.472116:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472125:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023524.472152:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472159:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417a58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a5f expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472174:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.472176:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.472178:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023524.472225:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024809856:0@lo:103: 00000100:00100000:2.0:1789023524.472269:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023524.472397:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809856 00000100:00100000:3.0:1789023524.472403:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809856 00010000:00010000:3.0:1789023524.472421:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 13 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023524.472466:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789023524.472474:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3310:x1875927024809856:12345-0@lo:103: 00010000:00010000:3.0:1789023524.472509:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023524.472514:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 13 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472525:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 13 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472537:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417a5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a58 expref: 13 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472551:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472559:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472573:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472580:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472586:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472593:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472620:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023524.472624:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472631:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472647:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472656:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023524.472686:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:3310:x1875927024809856:12345-0@lo:103: Request processed in 213us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.472693:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789023524.472850:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472859:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.472865:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417af2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789023524.472878:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789023524.473134:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0073100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024809856:0@lo:103: 00000100:00100000:1.0:1789023524.531930:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+11:7637:x1875927024808576:12345-0@lo:253: Request processed in 80329us (80740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.531961:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023524.532076:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024808576:0@lo:253: 10000000:01000000:0.0:1789023524.532092:0:7637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789023524.532095:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023524.532097:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789023524.532098:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023524.532100:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1789023524.532102:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023524.532103:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023524.532104:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023524.532106:0:7637:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789023524.532107:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023524.532109:0:7637:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789023524.532130:0:7637:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e65fc5ee000 from lustre-OST0001 10000000:01000000:0.0:1789023524.532152:0:7637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789023524.532155:0:7637:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789023524.532162:0:7637:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e65d2720000 local copy 10000000:01000000:0.0:1789023524.532166:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789023524.532325:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.532342:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.532352:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.532370:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024809984:0@lo:101: 00000100:00100000:0.0:1789023524.532404:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.532442:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322900 going to sleep for 11 seconds 00000100:00100000:2.0:1789023524.532508:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024809984 00000100:00100000:2.0:1789023524.532514:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024809984 00000100:00100000:2.0:1789023524.532554:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789023524.532670:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+11:7637:x1875927024809984:12345-0@lo:101: 00010000:00010000:2.0:1789023524.532683:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023524.532766:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417b00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417af9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.532790:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417af9 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.532801:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417b00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417af9 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.532810:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fd800, rc 0) 00000100:00100000:2.0:1789023524.532912:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024809984:12345-0@lo:101: Request processed in 350us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023524.532925:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789023524.533004:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024809984:0@lo:101: 00010000:00010000:0.0:1789023524.533016:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.533024:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.533128:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810112:0@lo:501: 00000100:00100000:0.0:1789023524.533153:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.533226:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.533439:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024810112 00000100:00100000:1.0:1789023524.533444:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024810112 00000100:00100000:1.0:1789023524.533844:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789023524.533854:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810112:12345-0@lo:501: 00000100:00100000:1.0:1789023524.534090:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810112:12345-0@lo:501: Request processed in 237us (935us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789023524.534097:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789023524.534173:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810112:0@lo:501: 10000000:01000000:2.0:1789023524.534200:0:7637:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789023524.534230:0:7637:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789023524.534238:0:7637:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.534248:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.534424:0:7637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.534450:0:7637:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789023524.534472:0:7637:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e65fc5ee000 10000000:01000000:2.0:1789023524.534494:0:7637:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789023524.534500:0:7637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789023524.534503:0:7637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789023524.534508:0:7637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789023524.534510:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789023524.534532:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.534540:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.534549:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023524.534585:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810240:0@lo:101: 00000100:00100000:2.0:1789023524.534617:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023524.534664:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023524.534671:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.534678:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023524.534681:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.534708:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023524.534716:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023524.534721:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023524.534740:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.534747:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023524.534765:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.534772:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417af9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc3c1fcbfb3417b00 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.534786:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.534788:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023524.534790:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023524.535044:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023524.535057:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024810368:0@lo:103: 00000100:00100000:3.0:1789023524.535087:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023524.535126:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024810368 00000100:00100000:3.0:1789023524.535131:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024810368 00000100:00100000:3.0:1789023524.535167:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023524.535174:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:3310:x1875927024810368:12345-0@lo:103: 00010000:00010000:3.0:1789023524.535185:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023524.535210:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417b00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417af9 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.535234:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023524.535393:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:3310:x1875927024810368:12345-0@lo:103: Request processed in 219us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.535400:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023524.535432:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024810368:0@lo:103: 00000100:00100000:2.0:1789023524.535679:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023524.535896:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024810240 00000100:00100000:0.0:1789023524.535903:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024810240 00000100:00100000:0.0:1789023524.535930:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789023524.535937:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+11:7637:x1875927024810240:12345-0@lo:101: 00010000:00010000:0.0:1789023524.535946:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023524.535959:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b07 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.535991:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.536001:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.536007:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04600, rc 0) 00000100:00100000:0.0:1789023524.536051:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810240:12345-0@lo:101: Request processed in 114us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023524.536056:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789023524.536134:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810240:0@lo:101: 00010000:00010000:2.0:1789023524.536147:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.536155:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023524.536379:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810496:0@lo:501: 00000100:00100000:2.0:1789023524.536408:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023524.536430:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023524.536497:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024810496 00000100:00100000:0.0:1789023524.536502:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024810496 00000100:00100000:0.0:1789023524.536519:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789023524.536524:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810496:12345-0@lo:501: 00000100:00100000:0.0:1789023524.536951:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810496:12345-0@lo:501: Request processed in 425us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023524.536958:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789023524.537110:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810496:0@lo:501: 00000100:00100000:2.0:1789023524.537138:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810624:0@lo:503: 00000100:00100000:2.0:1789023524.537176:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023524.537329:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023524.537383:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024810624 00000100:00100000:0.0:1789023524.537389:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024810624 00000100:00100000:0.0:1789023524.537422:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789023524.537428:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810624:12345-0@lo:503: 00000100:00100000:0.0:1789023524.537817:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810624:12345-0@lo:503: Request processed in 387us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023524.537824:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789023524.537932:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810624:0@lo:503: 00000040:00080000:2.0:1789023524.538394:0:7637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789023524.538470:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810752:0@lo:502: 00000100:00100000:2.0:1789023524.538536:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023524.538678:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.538809:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024810752 00000100:00100000:3.0:1789023524.538815:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024810752 00000100:00100000:1.0:1789023524.538931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789023524.538941:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810752:12345-0@lo:502: 00000100:00100000:1.0:1789023524.539157:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810752:12345-0@lo:502: Request processed in 217us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.539164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789023524.539922:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810752:0@lo:502: 00000040:00080000:3.0:1789023524.540422:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789023524.540652:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789023524.540764:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789023524.540822:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789023524.540930:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789023524.540965:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789023524.541008:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810880:0@lo:502: 00000100:00100000:3.0:1789023524.541073:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023524.541154:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c10be6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.541205:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024810880 00000100:00100000:1.0:1789023524.541213:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024810880 00000100:00100000:1.0:1789023524.541357:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789023524.541367:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810880:12345-0@lo:502: 00000100:00100000:1.0:1789023524.541626:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024810880:12345-0@lo:502: Request processed in 196us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.541635:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789023524.541730:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0072680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024810880:0@lo:502: 00000040:00080000:0.0:1789023524.541820:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789023524.542021:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789023524.543064:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789023524.543078:0:7647:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789023524.543084:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023524.543087:0:7647:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789023524.543092:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789023524.543107:0:7647:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e65d2788000) 00000020:00000080:2.0:1789023524.543127:0:7647:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789023524.543133:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789023524.543315:0:7647:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65fc5ee000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789023524.543323:0:7647:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789023524.543333:0:7647:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3c1fcbfb3417b1c 00010000:00010000:3.0:1789023524.548807:0:7647:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789023524.549142:0:7647:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789023524.552434:0:7647:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789023524.552771:0:7647:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789023524.558816:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789023524.559468:0:7647:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789023524.563073:0:7647:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789023524.563085:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023524.563092:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023524.563094:0:7647:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789023524.563097:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023524.563101:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023524.563110:0:7647:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789023524.563114:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023524.563116:0:7647:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789023524.563168:0:7647:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023524.563171:0:7647:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023524.563173:0:7647:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789023524.563176:0:7647:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789023524.563803:0:7637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789023524.563829:0:7637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789023524.563854:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.563867:0:7637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023524.563876:0:7637:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65fc5ee000 from 1 10000000:01000000:0.0:1789023524.563879:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023524.563937:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.564586:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.564599:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.564624:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811008:0@lo:101: 00000100:00100000:0.0:1789023524.564686:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.564744:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73220c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023524.564785:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811008 00000100:00100000:2.0:1789023524.564794:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811008 00000100:00100000:2.0:1789023524.564849:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789023524.564858:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+12:7637:x1875927024811008:12345-0@lo:101: 00010000:00010000:2.0:1789023524.564871:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023524.564884:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b23 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.564905:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.564915:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.564923:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fc800, rc 0) 00000100:00100000:2.0:1789023524.564968:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811008:12345-0@lo:101: Request processed in 111us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023524.564975:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789023524.565347:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811008:0@lo:101: 00010000:00010000:0.0:1789023524.565365:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.565374:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.565501:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811136:0@lo:501: 00000100:00100000:0.0:1789023524.565545:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.565583:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.565598:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811136 00000100:00100000:3.0:1789023524.565605:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811136 00000100:00100000:3.0:1789023524.565642:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789023524.565650:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811136:12345-0@lo:501: 00000100:00100000:3.0:1789023524.565894:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811136:12345-0@lo:501: Request processed in 244us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.565902:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789023524.566117:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811136:0@lo:501: 00000100:00100000:0.0:1789023524.566146:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811264:0@lo:503: 00000100:00100000:0.0:1789023524.566420:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.566440:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.566527:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811264 00000100:00100000:3.0:1789023524.566533:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811264 00000100:00100000:3.0:1789023524.566557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789023524.566564:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811264:12345-0@lo:503: 00000100:00100000:3.0:1789023524.567186:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811264:12345-0@lo:503: Request processed in 620us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.567194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789023524.567414:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811264:0@lo:503: 00000040:00080000:0.0:1789023524.567832:0:7637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789023524.567914:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811392:0@lo:502: 00000100:00100000:0.0:1789023524.567964:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.568005:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.568348:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811392 00000100:00100000:3.0:1789023524.568354:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811392 00000100:00100000:3.0:1789023524.568394:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789023524.568402:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811392:12345-0@lo:502: 00000100:00100000:3.0:1789023524.569381:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811392:12345-0@lo:502: Request processed in 978us (1414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.569390:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789023524.569747:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811392:0@lo:502: 00000040:00080000:0.0:1789023524.570132:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789023524.570256:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789023524.570291:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811520:0@lo:502: 00000100:00100000:0.0:1789023524.570343:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.570390:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.570455:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811520 00000100:00100000:3.0:1789023524.570467:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811520 00000100:00100000:3.0:1789023524.570588:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789023524.570597:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811520:12345-0@lo:502: 00000100:00100000:3.0:1789023524.570804:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811520:12345-0@lo:502: Request processed in 207us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.570811:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789023524.570853:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811520:0@lo:502: 00000040:00080000:1.0:1789023524.570958:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789023524.570970:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789023524.571956:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023524.571966:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023524.571969:0:7651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789023524.571974:0:7651:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65fc5ee000 00000020:00000080:3.0:1789023524.571977:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789023524.571996:0:7651:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023524.571999:0:7651:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023524.572000:0:7651:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789023524.572002:0:7651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789023524.572134:0:7637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789023524.572157:0:7637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023524.572200:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.572212:0:7637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023524.572343:0:7637:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789023524.572347:0:7637:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e65fc5ee000 10000000:01000000:0.0:1789023524.572350:0:7637:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e65fc5ee000 10000000:01000000:0.0:1789023524.572354:0:7637:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789023524.572359:0:7637:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65fc5ee000 from 1 10000000:01000000:0.0:1789023524.572361:0:7637:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789023524.572389:0:7637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.572397:0:7637:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.572407:0:7637:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.572424:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811648:0@lo:101: 00000100:00100000:0.0:1789023524.572466:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.572584:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.572813:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811648 00000100:00100000:3.0:1789023524.572820:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811648 00000100:00100000:3.0:1789023524.572882:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789023524.572891:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024811648:12345-0@lo:101: 00010000:00010000:3.0:1789023524.572901:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023524.572912:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b31 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.572933:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.572943:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.572951:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d600, rc 0) 00000100:00100000:3.0:1789023524.572997:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024811648:12345-0@lo:101: Request processed in 107us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.573004:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789023524.573062:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811648:0@lo:101: 00010000:00010000:0.0:1789023524.573075:0:7637:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.573084:0:7637:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.573155:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811776:0@lo:501: 00000100:00100000:0.0:1789023524.573176:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.573332:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.573358:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811776 00000100:00100000:1.0:1789023524.573362:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811776 00000100:00100000:1.0:1789023524.573381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789023524.573394:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024811776:12345-0@lo:501: 00000100:00100000:1.0:1789023524.573611:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024811776:12345-0@lo:501: Request processed in 217us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.573618:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789023524.573711:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811776:0@lo:501: 00000100:00100000:0.0:1789023524.573735:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811904:0@lo:503: 00000100:00100000:0.0:1789023524.573767:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.573785:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.573876:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024811904 00000100:00100000:1.0:1789023524.573880:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024811904 00000100:00100000:1.0:1789023524.573897:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789023524.573903:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024811904:12345-0@lo:503: 00000100:00100000:1.0:1789023524.574050:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024811904:12345-0@lo:503: Request processed in 146us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.574057:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789023524.574113:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024811904:0@lo:503: 00000040:00080000:0.0:1789023524.574347:0:7637:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789023524.574391:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024812032:0@lo:502: 00000100:00100000:0.0:1789023524.574420:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.574439:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.574552:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812032 00000100:00100000:1.0:1789023524.574556:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812032 00000100:00100000:1.0:1789023524.574572:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789023524.574577:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024812032:12345-0@lo:502: 00000100:00100000:1.0:1789023524.574931:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024812032:12345-0@lo:502: Request processed in 352us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.574938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789023524.575202:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024812032:0@lo:502: 00000040:00080000:0.0:1789023524.575684:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789023524.575814:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789023524.575847:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789023524.575933:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789023524.575973:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789023524.576023:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789023524.576060:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789023524.576093:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789023524.576138:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789023524.576173:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789023524.576207:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789023524.576333:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789023524.576374:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789023524.576403:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789023524.576448:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789023524.576812:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789023524.576853:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789023524.576903:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789023524.576966:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789023524.577001:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789023524.577052:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789023524.577090:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789023524.577131:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789023524.577201:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789023524.577240:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789023524.577351:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789023524.577405:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789023524.577459:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789023524.577785:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789023524.577845:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789023524.577893:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789023524.577939:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789023524.577981:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789023524.578049:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789023524.578087:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789023524.578135:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789023524.578171:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789023524.578215:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024812160:0@lo:502: 00000100:00100000:0.0:1789023524.578359:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.578457:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.578688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812160 00000100:00100000:1.0:1789023524.578759:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812160 00000100:00100000:0.0:1789023524.578888:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789023524.578898:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024812160:12345-0@lo:502: 00000100:00100000:0.0:1789023524.579167:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024812160:12345-0@lo:502: Request processed in 270us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023524.579175:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789023524.579247:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024812160:0@lo:502: 00000040:00080000:1.0:1789023524.579341:0:7637:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789023524.579353:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789023524.580530:0:7652:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789023524.580545:0:7652:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e65d27899c0) 00000020:00000080:2.0:1789023524.580564:0:7652:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789023524.580643:0:7652:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65fc5ee000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789023524.580647:0:7652:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65fc5ee000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789023524.580650:0:7652:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65fc5ee000 3 00010000:00080000:2.0:1789023524.580678:0:7652:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e64c2fe1800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.148@tcp at head 00010000:00010000:2.0:1789023524.584632:0:7652:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789023524.584878:0:7652:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789023524.584910:0:7652:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789023524.584921:0:7652:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3c1fcbfb3417b46 00000100:00080000:2.0:1789023524.584930:0:7652:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789023524.584940:0:7652:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e64c2fe1800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789023524.584973:0:7652:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65d2782d80 x1875927024812288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789023524.585002:0:7652:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789023524.585166:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875927024812288:0@lo:38: 00000100:00100000:3.0:1789023524.585234:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023524.585287:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024812544:0@lo:400: 00000100:00100000:1.0:1789023524.585320:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023524.585351:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023524.585358:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024812416:0@lo:400: 00000100:00100000:3.0:1789023524.585386:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812288 00000100:00100000:1.0:1789023524.585392:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023524.585394:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812288 00000100:00100000:3.0:1789023524.585417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812544 00000100:00100000:3.0:1789023524.585419:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812544 00000100:00100000:1.0:1789023524.585435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812416 00000100:00100000:1.0:1789023524.585440:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812416 00000100:00100000:3.0:1789023524.585455:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789023524.585467:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024812544:12345-0@lo:400: 00000100:00100000:1.0:1789023524.585470:0:5847:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789023524.585504:0:5847:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789023524.585518:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024812672:0@lo:400: 00000100:00100000:3.0:1789023524.585545:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024812544:12345-0@lo:400: Request processed in 81us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.585555:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023524.585558:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023524.585573:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789023524.585579:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024812416:12345-0@lo:400: 00000100:00100000:3.0:1789023524.585602:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024812416:12345-0@lo:400: Request processed in 24us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.585606:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789023524.585616:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023524.585619:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875927024812288:12345-0@lo:38: 00010000:00080000:3.0:1789023524.585636:0:5845:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:3.0:1789023524.585661:0:5845:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3c1fcbfb3417b4d 00000004:00100000:3.0:1789023524.585672:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789023524.585707:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8e65e77ae800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023524.585739:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0072300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875927024812288:12345-0@lo:38: Request processed in 118us (506us total) trans 0 rc 0/0 00000100:00080000:1.0:1789023524.585879:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023524.585892:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812672 00000100:00100000:1.0:1789023524.585896:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812672 00000100:00100000:1.0:1789023524.585926:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023524.585936:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024812672:12345-0@lo:400: 00000100:00100000:3.0:1789023524.585939:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789023524.585980:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d2782d80 x1875927024812288/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023524.585985:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024812672:12345-0@lo:400: Request processed in 49us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023524.585998:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:1.0:1789023524.585999:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789023524.586008:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789023524.586015:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789023524.586020:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789023524.586023:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e64c2fe1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789023524.586023:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023524.586033:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875927024812288:0@lo:38: 00010000:00080000:1.0:1789023524.586046:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65e77e2300 x1875927024812672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023524.586058:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024812672:0@lo:400: 00010000:00080000:1.0:1789023524.586080:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65e77e3480 x1875927024812416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023524.586088:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024812416:0@lo:400: 00010000:00080000:1.0:1789023524.586097:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65e77e0380 x1875927024812544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023524.586104:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024812544:0@lo:400: 00000100:00100000:3.0:1789023524.587000:0:7653:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7653:1875927024812800:0@lo:901: 00000100:00100000:3.0:1789023524.587047:0:7653:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789023524.587056:0:7652:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1789023524.587088:0:7653:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f79ea600 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.587401:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812800 00000100:00100000:1.0:1789023524.587412:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812800 00000100:00080000:2.0:1789023524.587471:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023524.587471:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000020:01000000:2.0:1789023524.588586:0:7637:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789023524.588622:0:7637:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789023524.588643:0:7637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023524.588654:0:7637:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789023524.588825:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789023524.588828:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789023524.588829:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023524.588831:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023524.588832:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023524.588834:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023524.588836:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023524.588837:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023524.588845:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023524.588846:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023524.588848:0:7637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789023524.588852:0:7637:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789023524.588854:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789023524.588856:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789023524.588856:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023524.588858:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023524.588859:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023524.588860:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023524.588861:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023524.588862:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023524.588863:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023524.588864:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023524.588864:0:7637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789023524.588886:0:7637:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789023524.588899:0:7637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024812928:0@lo:253: 00000100:00100000:2.0:1789023524.588955:0:7637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023524.588987:0:7637:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324000 going to sleep for 11 seconds 00000100:00100000:3.0:1789023524.589369:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024812928 00000100:00100000:3.0:1789023524.589377:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024812928 00000100:00100000:3.0:1789023524.589424:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789023524.589435:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:7637:x1875927024812928:12345-0@lo:253: 20000000:01000000:3.0:1789023524.589458:0:5840:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789023524.589471:0:5840:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789023524.593538:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1875927024812800:12345-0@lo:901: 00000100:00100000:1.0:1789023524.593940:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7653:x1875927024812800:12345-0@lo:901: Request processed in 6428us (6890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.593951:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789023524.594529:0:7653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65d0071880 x1875927024812800/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789023540 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023524.594544:0:7653:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7653:1875927024812800:0@lo:901: 20000000:01000000:1.0:1789023524.641227:0:5840:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789023524.641248:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789023524.642228:0:5861:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789023524.642234:0:5861:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789023524.642263:0:5861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.642294:0:5861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.642303:0:5861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.642346:0:5861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023524.642359:0:5861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 14 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023524.642373:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875927024813056:0@lo:104: 00000100:00100000:0.0:1789023524.642430:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023524.642465:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322300 going to sleep for 11 seconds 00000100:00100000:1.0:1789023524.642776:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813056 00000100:00100000:1.0:1789023524.642785:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813056 00000100:00100000:1.0:1789023524.642828:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023524.642837:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5861:x1875927024813056:12345-0@lo:104: 00010000:00010000:1.0:1789023524.642849:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.642915:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023524.642920:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:5861:x1875927024813056:12345-0@lo:104: Request processed in 85us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.642927:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023524.648405:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5861:1875927024813056:0@lo:104: 00010000:00010000:1.0:1789023524.648432:0:5861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.648453:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023524.648460:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.648467:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e6602167200 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023524.648471:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.648864:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023524.648873:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023524.648879:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789023524.648930:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.648937:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023524.648953:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.648961:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e6602167200/0xc3c1fcbfb3417a90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a97 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.648979:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023524.648981:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023524.648983:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023524.649004:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024813184:0@lo:103: 00000100:00100000:1.0:1789023524.649817:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023524.649950:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813184 00000100:00100000:1.0:1789023524.649957:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813184 00010000:00010000:1.0:1789023524.649987:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 15 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023524.650019:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023524.650028:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:3311:x1875927024813184:12345-0@lo:103: 00010000:00010000:1.0:1789023524.650053:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023524.650327:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 15 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650340:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 15 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650354:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417a97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a90 expref: 15 pid: 5840 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650368:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650376:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789023524.650391:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008158061s 00010000:00010000:1.0:1789023524.650395:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650402:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650409:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650414:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650618:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023524.650623:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650640:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650655:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023524.650665:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023524.650723:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:3311:x1875927024813184:12345-0@lo:103: Request processed in 696us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.650731:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023524.650797:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024813184:0@lo:103: 00010000:00010000:3.0:1789023524.650925:0:5861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.650934:0:5861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023524.650940:0:5861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d05800/0xc3c1fcbfb3417b54 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023524.660971:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:7637:x1875927024812928:12345-0@lo:253: Request processed in 71528us (72006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023524.660985:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789023524.661099:0:7637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72bd38e6-1e7e-4158-85a3-542824dd2807:7637:1875927024812928:0@lo:253: 10000000:01000000:2.0:1789023524.661114:0:7637:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789023524.661117:0:7637:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789023524.661119:0:7637:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789023524.661120:0:7637:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023524.661121:0:7637:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023524.661122:0:7637:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023524.661123:0:7637:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023524.661124:0:7637:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023524.661126:0:7637:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789023524.661127:0:7637:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789023524.661129:0:7637:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023524.661130:0:7637:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789023524.661157:0:7637:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789023524.676376:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789023524.676918:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789023524.680609:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789023524.680930:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789023524.683324:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789023524.683890:0:7637:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789023524.687741:0:7637:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789023524.903429:0:7637:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789023524.903436:0:7637:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789023524.903467:0:7637:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789023524.903649:0:7637:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789023524.903665:0:7637:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789023524.903688:0:7637:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789023525.130625:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023525.897739:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023525.897763:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024813312:0@lo:13: 00000100:00100000:1.0:1789023525.897831:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023525.897892:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813312 00000100:00100000:1.0:1789023525.897901:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813312 00000100:00100000:1.0:1789023525.897946:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023525.897956:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024813312:12345-0@lo:13: 00002000:00000024:1.0:1789023525.897988:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023525.898031:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024813312:12345-0@lo:13: Request processed in 77us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023525.898057:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789023525.898099:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e0380 x1875927024813312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023541 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023525.898116:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024813312:0@lo:13: 00010000:00010000:3.0:1789023526.153743:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023527.177668:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023528.203185:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023529.226754:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023529.997255:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024813440:0@lo:400: 00000100:00100000:1.0:1789023529.997323:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023529.997363:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024813952:0@lo:400: 00000100:00100000:1.0:1789023529.997402:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023529.997426:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023529.997432:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024813824:0@lo:400: 00000100:00100000:1.0:1789023529.997453:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023529.997489:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024813568:0@lo:400: 00000100:00100000:1.0:1789023529.997511:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023529.997526:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023529.997531:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024813696:0@lo:400: 00000100:00100000:1.0:1789023529.997611:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023529.997645:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813952 00000100:00100000:1.0:1789023529.997652:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813952 00000100:00100000:1.0:1789023529.997717:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813568 00000100:00100000:1.0:1789023529.997721:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813568 00000100:00100000:1.0:1789023529.997734:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813696 00000100:00100000:1.0:1789023529.997736:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813696 00000100:00100000:1.0:1789023529.997754:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023529.997762:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024813952:12345-0@lo:400: 00000100:00100000:1.0:1789023529.997811:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024813952:12345-0@lo:400: Request processed in 49us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023529.997834:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023529.997852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023529.997858:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024813568:12345-0@lo:400: 00000100:00100000:1.0:1789023529.997891:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024813568:12345-0@lo:400: Request processed in 32us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023529.997896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023529.997908:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023529.997914:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024813696:12345-0@lo:400: 00000100:00100000:1.0:1789023529.997939:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024813696:12345-0@lo:400: Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023529.997944:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1789023529.997960:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023529.997983:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e0000 x1875927024813952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023529.997995:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024813952:0@lo:400: 00010000:00080000:1.0:1789023529.998017:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e1880 x1875927024813696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023529.998026:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024813696:0@lo:400: 00010000:00080000:1.0:1789023529.998035:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e2300 x1875927024813568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023529.998042:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024813568:0@lo:400: 00000100:00100000:0.0:1789023530.003057:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813440 00000100:00100000:0.0:1789023530.003071:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813440 00000100:00100000:0.0:1789023530.003135:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789023530.003144:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3313:x1875927024813440:12345-0@lo:400: 00000100:00100000:0.0:1789023530.003224:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3313:x1875927024813440:12345-0@lo:400: Request processed in 81us (5900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023530.003230:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789023530.003262:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024813824 00000100:00100000:0.0:1789023530.003266:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024813824 00000100:00100000:0.0:1789023530.003299:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023530.003305:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024813824:12345-0@lo:400: 00000100:00100000:0.0:1789023530.003345:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024813824:12345-0@lo:400: Request processed in 41us (5891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023530.003351:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789023530.003427:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e3100 x1875927024813824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023530.003441:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024813824:0@lo:400: 00000100:00100000:0.0:1789023530.003453:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024813440:0@lo:400: 00000100:00080000:0.0:1789023530.003496:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789023530.251986:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789023530.672208:0:7997:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789023531.019114:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023531.019139:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024814080:0@lo:13: 00000100:00100000:3.0:1789023531.019200:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023531.020224:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814080 00000100:00100000:2.0:1789023531.020236:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814080 00000100:00100000:2.0:1789023531.020291:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023531.020302:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024814080:12345-0@lo:13: 00002000:00000024:2.0:1789023531.020334:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023531.020404:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0073100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024814080:12345-0@lo:13: Request processed in 104us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023531.020411:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789023531.020509:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2782300 x1875927024814080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023547 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023531.020540:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024814080:0@lo:13: 00010000:00010000:3.0:1789023531.273903:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023532.297850:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789023533.067832:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789023533.067904:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65d089d800 from 30 10000000:01000000:3.0:1789023533.067909:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789023533.067958:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.067970:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.067981:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023533.068005:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814208:0@lo:101: 00000100:00100000:3.0:1789023533.068092:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.068172:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec180 going to sleep for 11 seconds 00000100:00100000:1.0:1789023533.068993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814208 00000100:00100000:1.0:1789023533.069003:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814208 00000100:00100000:1.0:1789023533.069078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789023533.069087:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024814208:12345-0@lo:101: 00010000:00010000:1.0:1789023533.069100:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023533.069115:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b5b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023533.069141:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023533.069153:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023533.069162:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c1668800, rc 0) 00000100:00100000:1.0:1789023533.069223:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024814208:12345-0@lo:101: Request processed in 137us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.069230:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789023533.069529:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814208:0@lo:101: 00010000:00010000:3.0:1789023533.069548:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.069559:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023533.069622:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814336:0@lo:501: 00000100:00100000:3.0:1789023533.069664:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.069696:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec180 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.069925:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814336 00000100:00100000:0.0:1789023533.069930:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814336 00000100:00100000:0.0:1789023533.069969:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789023533.069977:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024814336:12345-0@lo:501: 00000100:00100000:0.0:1789023533.070235:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024814336:12345-0@lo:501: Request processed in 259us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023533.070244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789023533.070497:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814336:0@lo:501: 00000100:00100000:3.0:1789023533.070530:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814464:0@lo:503: 00000100:00100000:3.0:1789023533.070571:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.070600:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec180 going to sleep for 11 seconds 00000100:00100000:1.0:1789023533.070667:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814464 00000100:00100000:1.0:1789023533.070674:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814464 00000100:00100000:1.0:1789023533.070799:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789023533.070808:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024814464:12345-0@lo:503: 00000100:00100000:1.0:1789023533.070972:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024814464:12345-0@lo:503: Request processed in 165us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.070979:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789023533.071160:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814464:0@lo:503: 00000100:00100000:3.0:1789023533.071396:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8102:1875927024814592:0@lo:502: 00000100:00100000:3.0:1789023533.071432:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.072571:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.073105:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814592 00000100:00100000:2.0:1789023533.073114:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814592 00000100:00100000:2.0:1789023533.073166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789023533.073175:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8102:x1875927024814592:12345-0@lo:502: 00000100:00100000:2.0:1789023533.073810:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8102:x1875927024814592:12345-0@lo:502: Request processed in 634us (2375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.073819:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789023533.073962:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8102:1875927024814592:0@lo:502: 00000100:00100000:3.0:1789023533.074027:0:8102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8102:1875927024814720:0@lo:502: 00000100:00100000:3.0:1789023533.074066:0:8102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.074137:0:8102:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec300 going to sleep for 11 seconds 00000100:00100000:1.0:1789023533.074174:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814720 00000100:00100000:1.0:1789023533.074181:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814720 00000100:00100000:1.0:1789023533.074213:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789023533.074220:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8102:x1875927024814720:12345-0@lo:502: 00000100:00100000:1.0:1789023533.074576:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8102:x1875927024814720:12345-0@lo:502: Request processed in 355us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.074589:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789023533.074659:0:8102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8102:1875927024814720:0@lo:502: 00000040:00080000:3.0:1789023533.074688:0:8102:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789023533.074926:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789023533.074945:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023533.074955:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.074967:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023533.074989:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789023533.074991:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789023533.074994:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789023533.075019:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.075028:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.075036:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023533.075049:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814848:0@lo:101: 00000100:00100000:0.0:1789023533.075079:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.075222:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.075331:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814848 00000100:00100000:2.0:1789023533.075337:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814848 00000100:00100000:2.0:1789023533.075408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789023533.075417:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024814848:12345-0@lo:101: 00010000:00010000:2.0:1789023533.075427:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023533.075440:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b69 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023533.075460:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023533.075516:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023533.075526:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fda00, rc 0) 00000100:00100000:2.0:1789023533.075564:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024814848:12345-0@lo:101: Request processed in 147us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.075570:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789023533.075671:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40ebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814848:0@lo:101: 00010000:00010000:3.0:1789023533.075685:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.075694:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023533.075747:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814976:0@lo:501: 00000100:00100000:3.0:1789023533.075772:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.076046:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec300 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.076097:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024814976 00000100:00100000:0.0:1789023533.076102:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024814976 00000100:00100000:0.0:1789023533.076122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789023533.076128:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024814976:12345-0@lo:501: 00000100:00100000:0.0:1789023533.076736:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024814976:12345-0@lo:501: Request processed in 605us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023533.076743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789023533.076964:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024814976:0@lo:501: 00000100:00100000:3.0:1789023533.077004:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815104:0@lo:503: 00000100:00100000:3.0:1789023533.077044:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.077113:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.077146:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024815104 00000100:00100000:2.0:1789023533.077151:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024815104 00000100:00100000:2.0:1789023533.077218:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789023533.077226:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024815104:12345-0@lo:503: 00000100:00100000:2.0:1789023533.077654:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024815104:12345-0@lo:503: Request processed in 429us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.077662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789023533.077860:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815104:0@lo:503: 00000100:00100000:3.0:1789023533.078245:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8103:1875927024815232:0@lo:502: 00000100:00100000:3.0:1789023533.078293:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.078708:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.079014:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024815232 00000100:00100000:0.0:1789023533.079021:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024815232 00000100:00100000:0.0:1789023533.079052:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789023533.079059:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8103:x1875927024815232:12345-0@lo:502: 00000100:00100000:0.0:1789023533.079269:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8103:x1875927024815232:12345-0@lo:502: Request processed in 209us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023533.079282:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789023533.079371:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8103:1875927024815232:0@lo:502: 00000020:01000000:3.0:1789023533.079398:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023533.079406:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023533.079408:0:8103:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789023533.079412:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023533.079414:0:8103:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789023533.079435:0:8103:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8103:1875927024815360:0@lo:502: 00000100:00100000:3.0:1789023533.079471:0:8103:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.079516:0:8103:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.079579:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024815360 00000100:00100000:2.0:1789023533.079583:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024815360 00000100:00100000:2.0:1789023533.079604:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789023533.079609:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8103:x1875927024815360:12345-0@lo:502: 00000100:00100000:2.0:1789023533.080004:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8103:x1875927024815360:12345-0@lo:502: Request processed in 393us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.080012:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789023533.080120:0:8103:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8103:1875927024815360:0@lo:502: 00000020:01000000:3.0:1789023533.080143:0:8103:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023533.080149:0:8103:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023533.080150:0:8103:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789023533.080154:0:8103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789023533.080329:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789023533.080348:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789023533.080357:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023533.080368:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023533.080377:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789023533.080379:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65d252c800 from 30 10000000:01000000:1.0:1789023533.080382:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789023533.080410:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023533.080417:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023533.080426:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023533.080440:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815488:0@lo:101: 00000100:00100000:1.0:1789023533.080470:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023533.080650:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c32086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.080687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024815488 00000100:00100000:0.0:1789023533.080692:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024815488 00000100:00100000:0.0:1789023533.080818:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789023533.080827:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024815488:12345-0@lo:101: 00010000:00010000:0.0:1789023533.080906:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023533.080919:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b77 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.080940:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.080951:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.080958:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04000, rc 0) 00000100:00100000:0.0:1789023533.081044:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024815488:12345-0@lo:101: Request processed in 218us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023533.081050:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789023533.081122:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815488:0@lo:101: 00010000:00010000:1.0:1789023533.081135:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023533.081143:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023533.081200:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815616:0@lo:501: 00000100:00100000:1.0:1789023533.081225:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023533.081281:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c32086c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.081317:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024815616 00000100:00100000:0.0:1789023533.081323:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024815616 00000100:00100000:0.0:1789023533.081717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789023533.081821:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024815616:12345-0@lo:501: 00000100:00100000:0.0:1789023533.082269:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024815616:12345-0@lo:501: Request processed in 544us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023533.082277:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789023533.082422:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815616:0@lo:501: 00000100:00100000:1.0:1789023533.082458:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815744:0@lo:503: 00000100:00100000:1.0:1789023533.082521:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023533.082546:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c32086c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023533.082614:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024815744 00000100:00100000:3.0:1789023533.082620:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024815744 00000100:00100000:3.0:1789023533.082715:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789023533.082800:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024815744:12345-0@lo:503: 00000100:00100000:3.0:1789023533.085598:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024815744:12345-0@lo:503: Request processed in 2866us (3068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023533.085612:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789023533.085831:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024815744:0@lo:503: 00000100:00100000:1.0:1789023533.092323:0:8104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8104:1875927024815872:0@lo:502: 00000100:00100000:1.0:1789023533.092418:0:8104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023533.092464:0:8104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208180 going to sleep for 11 seconds 00000100:00100000:3.0:1789023533.092515:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024815872 00000100:00100000:3.0:1789023533.092523:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024815872 00000100:00100000:3.0:1789023533.092573:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789023533.092583:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8104:x1875927024815872:12345-0@lo:502: 00000100:00100000:3.0:1789023533.092957:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8104:x1875927024815872:12345-0@lo:502: Request processed in 375us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023533.092965:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789023533.093038:0:8104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8104:1875927024815872:0@lo:502: 00000100:00100000:1.0:1789023533.093092:0:8104:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8104:1875927024816000:0@lo:502: 00000100:00100000:1.0:1789023533.093128:0:8104:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023533.093209:0:8104:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208180 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.094761:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816000 00000100:00100000:2.0:1789023533.094771:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816000 00000100:00100000:2.0:1789023533.094870:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789023533.094880:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8104:x1875927024816000:12345-0@lo:502: 00000100:00100000:2.0:1789023533.095132:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8104:x1875927024816000:12345-0@lo:502: Request processed in 253us (2003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.095145:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789023533.095243:0:8104:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8104:1875927024816000:0@lo:502: 00000040:00080000:3.0:1789023533.095404:0:8104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789023533.096366:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789023533.096389:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023533.096408:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.096420:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023533.096430:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789023533.096432:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65d252c800 from 5 10000000:01000000:0.0:1789023533.096435:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789023533.096467:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.096503:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.096515:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023533.096534:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816128:0@lo:101: 00000100:00100000:0.0:1789023533.096589:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.096626:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868840 going to sleep for 11 seconds 00000100:00100000:3.0:1789023533.096733:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816128 00000100:00100000:3.0:1789023533.096739:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816128 00000100:00100000:3.0:1789023533.096779:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789023533.096788:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024816128:12345-0@lo:101: 00010000:00010000:3.0:1789023533.096804:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023533.096819:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713c400/0xc3c1fcbfb3417b8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b85 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.096939:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713c400/0xc3c1fcbfb3417b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b85 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.096952:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713c400/0xc3c1fcbfb3417b8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b85 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.096960:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c400, rc 0) 00000100:00100000:3.0:1789023533.096995:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024816128:12345-0@lo:101: Request processed in 208us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023533.097001:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789023533.097076:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816128:0@lo:101: 00010000:00010000:0.0:1789023533.097089:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.097098:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023533.097142:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816256:0@lo:256: 00000100:00100000:0.0:1789023533.097177:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.097206:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868840 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.097271:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816256 00000100:00100000:2.0:1789023533.097276:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816256 00000100:00100000:2.0:1789023533.097307:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789023533.097314:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024816256:12345-0@lo:256: 20000000:01000000:2.0:1789023533.097327:0:5840:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789023533.097344:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789023533.097347:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789023533.097430:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024816256:12345-0@lo:256: Request processed in 115us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.097436:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789023533.097661:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816256:0@lo:256: 10000000:01000000:0.0:1789023533.097709:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789023533.097715:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.097731:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023533.097739:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789023533.097741:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1789023533.097743:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789023533.097759:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.097766:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.097774:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023533.097787:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816384:0@lo:101: 00000100:00100000:0.0:1789023533.097813:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.097961:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816384 00000100:00100000:3.0:1789023533.097966:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816384 00000100:00100000:3.0:1789023533.098004:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789023533.098011:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024816384:12345-0@lo:101: 00010000:00010000:3.0:1789023533.098018:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023533.098027:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417b93 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.098043:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.098051:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.098058:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d400, rc 0) 00000100:00100000:3.0:1789023533.098091:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024816384:12345-0@lo:101: Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023533.098096:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789023533.098143:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868840 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.098158:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816384:0@lo:101: 00010000:00010000:0.0:1789023533.098168:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.098186:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023533.098229:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816512:0@lo:501: 00000100:00100000:0.0:1789023533.098266:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.098286:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868840 going to sleep for 11 seconds 00000100:00100000:1.0:1789023533.098332:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816512 00000100:00100000:1.0:1789023533.098338:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816512 00000100:00100000:1.0:1789023533.098380:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789023533.098388:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024816512:12345-0@lo:501: 00000100:00100000:1.0:1789023533.099678:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024816512:12345-0@lo:501: Request processed in 1288us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.099688:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789023533.099754:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816512:0@lo:501: 00000100:00100000:0.0:1789023533.099790:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816640:0@lo:503: 00000100:00100000:0.0:1789023533.099836:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.099871:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868840 going to sleep for 11 seconds 00000100:00100000:3.0:1789023533.099916:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816640 00000100:00100000:3.0:1789023533.099922:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816640 00000100:00100000:3.0:1789023533.099959:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789023533.099968:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024816640:12345-0@lo:503: 00000100:00100000:3.0:1789023533.100194:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024816640:12345-0@lo:503: Request processed in 227us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023533.100201:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789023533.100572:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024816640:0@lo:503: 00000100:00100000:0.0:1789023533.101114:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8105:1875927024816768:0@lo:502: 00000100:00100000:0.0:1789023533.101156:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.101195:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023533.101328:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816768 00000100:00100000:1.0:1789023533.101339:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816768 00000100:00100000:1.0:1789023533.101378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789023533.101386:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8105:x1875927024816768:12345-0@lo:502: 00000100:00100000:1.0:1789023533.104974:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8105:x1875927024816768:12345-0@lo:502: Request processed in 3512us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.104988:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789023533.105281:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40eb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8105:1875927024816768:0@lo:502: 00000020:01000000:0.0:1789023533.105333:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789023533.105341:0:8105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789023533.105349:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023533.105351:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789023533.105357:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789023533.105361:0:8105:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:0.0:1789023533.105387:0:8105:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789023533.105390:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023533.105405:0:8105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e65f0044d40) 00000020:00000080:0.0:1789023533.105424:0:8105:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789023533.105440:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789023533.105797:0:8105:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789023533.105803:0:8105:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789023533.105810:0:8105:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3417ba8 00010000:00080000:0.0:1789023533.105841:0:8105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65e77af800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789023533.106650:0:8105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1789023533.111382:0:8105:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789023533.111401:0:8105:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789023533.118629:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023533.121247:0:8105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023533.121317:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789023533.121384:0:8105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789023533.122549:0:8106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023533.122556:0:8106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789023533.124458:0:8105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789023533.124473:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789023533.127500:0:8105:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789023533.127600:0:8105:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3417baf 00000100:00080000:3.0:1789023533.127926:0:8105:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023533.127939:0:8105:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e65e77af800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789023533.127979:0:8105:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65d0070a80 x1875927024816896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789023533.128257:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024816896:0@lo:8: 00000100:00100000:0.0:1789023533.128322:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789023533.128390:0:8105:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789023533.128504:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023533.128519:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023533.128522:0:8105:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789023533.128526:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023533.128531:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023533.128532:0:8105:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789023533.128535:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023533.128537:0:8105:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789023533.128563:0:8105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8105:1875927024817024:0@lo:502: 00000100:00100000:3.0:1789023533.128626:0:8105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.128679:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817024 00000100:00100000:3.0:1789023533.128687:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817024 00000100:00100000:3.0:1789023533.128738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789023533.128749:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8105:x1875927024817024:12345-0@lo:502: 00000100:00100000:2.0:1789023533.128782:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024817152:0@lo:400: 00000100:00100000:2.0:1789023533.128820:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023533.128852:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023533.128859:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024817536:0@lo:400: 00000100:00100000:2.0:1789023533.128884:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023533.128914:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024817280:0@lo:400: 00000100:00100000:2.0:1789023533.128938:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023533.128974:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023533.128982:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024817408:0@lo:400: 00000100:00100000:2.0:1789023533.129019:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817152 00000100:00100000:2.0:1789023533.129024:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817152 00000100:00100000:3.0:1789023533.129038:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8105:x1875927024817024:12345-0@lo:502: Request processed in 291us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023533.129047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789023533.129058:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817536 00000100:00100000:2.0:1789023533.129062:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817536 00000100:00100000:2.0:1789023533.129089:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817280 00000100:00100000:2.0:1789023533.129093:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817280 00000100:00100000:3.0:1789023533.129101:0:8105:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d07c5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.129115:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789023533.129122:0:8105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8105:1875927024817024:0@lo:502: 00000100:00100000:2.0:1789023533.129126:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024817152:12345-0@lo:400: 00000020:01000000:3.0:1789023533.129151:0:8105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023533.129157:0:8105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023533.129158:0:8105:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789023533.129162:0:8105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:2.0:1789023533.129181:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024817152:12345-0@lo:400: Request processed in 58us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.129190:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023533.129207:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789023533.129214:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024817536:12345-0@lo:400: 00000020:01000000:3.0:1789023533.129218:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789023533.129236:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789023533.129246:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023533.129246:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024817536:12345-0@lo:400: Request processed in 31us (360us total) trans 0 rc 0/0 00010000:00010000:3.0:1789023533.129259:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023533.129271:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 10000000:01000000:3.0:1789023533.129276:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789023533.129280:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e65d2720000 from 1 10000000:01000000:3.0:1789023533.129284:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00000100:00100000:2.0:1789023533.129288:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789023533.129296:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024817280:12345-0@lo:400: 00010000:00010000:3.0:1789023533.129308:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.129318:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023533.129334:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024817280:12345-0@lo:400: Request processed in 38us (393us total) trans 0 rc 0/0 00010000:00010000:3.0:1789023533.129345:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023533.129345:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023533.129363:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024817664:0@lo:101: 00000100:00080000:2.0:1789023533.129370:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023533.129398:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789023533.129398:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2780a80 x1875927024817536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.129411:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024817536:0@lo:400: 00000100:00100000:3.0:1789023533.129417:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c574a480 going to sleep for 11 seconds 00010000:00080000:2.0:1789023533.129426:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2783480 x1875927024817152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.129435:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024817152:0@lo:400: 00000100:00100000:2.0:1789023533.130323:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.131995:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817664 00000100:00100000:0.0:1789023533.132006:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817664 00000100:00100000:0.0:1789023533.132063:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789023533.132073:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024817664:12345-0@lo:101: 00010000:00010000:0.0:1789023533.132087:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023533.132103:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417bb6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.132129:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.132139:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023533.132148:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05400, rc 0) 00000100:00100000:0.0:1789023533.132223:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024817664:12345-0@lo:101: Request processed in 152us (2828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023533.132229:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789023533.132351:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024817664:0@lo:101: 00010000:00010000:3.0:1789023533.132367:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.132376:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023533.132432:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024817792:0@lo:501: 00000100:00100000:3.0:1789023533.132461:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.132630:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c574a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789023533.134169:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024816896 00000100:00100000:1.0:1789023533.134180:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024816896 00000100:00100000:1.0:1789023533.134221:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817408 00000100:00100000:1.0:1789023533.134224:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817408 00000100:00100000:1.0:1789023533.134265:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023533.134275:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024817408:12345-0@lo:400: 00000100:00100000:1.0:1789023533.134342:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024817408:12345-0@lo:400: Request processed in 68us (4020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.134349:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023533.134366:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023533.134370:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875927024816896:12345-0@lo:8: 00010000:00080000:1.0:1789023533.134392:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1789023533.134422:0:6695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3417bc4 00002000:00100000:1.0:1789023533.134436:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e65d090d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789023533.134440:0:6695:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1789023533.134443:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789023533.134466:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817792 00000100:00100000:0.0:1789023533.134473:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817792 00000100:00100000:0.0:1789023533.134704:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789023533.134713:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024817792:12345-0@lo:501: 00000100:00100000:0.0:1789023533.135078:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024817792:12345-0@lo:501: Request processed in 365us (2614us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789023533.135085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789023533.136234:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024817792:0@lo:501: 10000000:01000000:3.0:1789023533.136275:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789023533.136284:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023533.136294:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1789023533.136803:0:6695:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789023533.137146:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789023533.137176:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8e65d090c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023533.137242:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875927024816896:12345-0@lo:8: Request processed in 2870us (8920us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.137266:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789023533.137306:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023533.138299:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d0070a80 x1875927024816896/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023543 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023533.138311:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789023533.138318:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789023533.138325:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789023533.138330:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789023533.138332:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e77af800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789023533.138358:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789023533.138363:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024816896:0@lo:8: 00000004:00080000:0.0:1789023533.138389:0:8106:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789023533.138550:0:8106:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 199209071664ns, next at 0ns, rc = 0 00010000:00080000:2.0:1789023533.138848:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2782680 x1875927024817408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.138859:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024817408:0@lo:400: 00010000:00080000:2.0:1789023533.138888:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2783b80 x1875927024817280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.138897:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024817280:0@lo:400: 00000004:00080000:2.0:1789023533.208189:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:2.0:1789023533.250950:0:8107:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789023533.250979:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818048:0@lo:7: 00000100:00100000:2.0:1789023533.251041:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023533.252365:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f79ea480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023533.252393:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024817920:0@lo:13: 00000100:00100000:2.0:1789023533.252439:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023533.252810:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024817920 00000100:00100000:0.0:1789023533.252818:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024817920 00000100:00100000:0.0:1789023533.253039:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023533.253049:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875927024817920:12345-0@lo:13: 00000100:00100000:3.0:1789023533.253073:0:6697:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1789023533.253082:0:6697:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1789023533.253399:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789023533.253468:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875927024817920:12345-0@lo:13: Request processed in 409us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023533.253502:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789023533.253843:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789023533.254130:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2783b80 x1875927024817920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.254153:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024817920:0@lo:13: 00000100:00100000:2.0:1789023533.254204:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818048 00000100:00100000:2.0:1789023533.254210:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818048 00000100:00100000:2.0:1789023533.254253:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023533.254262:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8107:x1875927024818048:12345-0@lo:7: 00002000:00080000:3.0:1789023533.266376:0:6695:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789023533.266384:0:6695:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789023533.266508:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8107:x1875927024818048:12345-0@lo:7: Request processed in 12210us (15429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023533.266520:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789023533.267746:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2782680 x1875927024818048/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789023549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023533.267765:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818048:0@lo:7: 00000004:00080000:3.0:1789023533.267783:0:8107:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789023533.267827:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818176:0@lo:5: 00000100:00100000:3.0:1789023533.268090:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.268149:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023533.268177:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818176 00000100:00100000:3.0:1789023533.268184:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818176 00000100:00100000:3.0:1789023533.268248:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789023533.268258:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8107:x1875927024818176:12345-0@lo:5: 00002000:00080000:3.0:1789023533.268285:0:7164:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789023533.268289:0:7164:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789023533.268661:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:8107:x1875927024818176:12345-0@lo:5: Request processed in 402us (571us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789023533.268677:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789023533.268717:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d0071f80 x1875927024818176/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023533.268735:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818176:0@lo:5: 00000004:00080000:3.0:1789023533.268745:0:8107:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789023533.268774:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818304:0@lo:700: 00000100:00100000:3.0:1789023533.268829:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.268848:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023533.268873:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818304 00000100:00100000:3.0:1789023533.268878:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818304 00000100:00100000:3.0:1789023533.268907:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023533.268915:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8107:x1875927024818304:12345-0@lo:700: 00000100:00100000:3.0:1789023533.268945:0:6702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6702:1875927024818432:0@lo:700: 00000100:00100000:3.0:1789023533.268972:0:6702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.268994:0:6702:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.269004:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818432 00000100:00100000:0.0:1789023533.269011:0:5852:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818432 00000100:00100000:0.0:1789023533.269101:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023533.269111:0:5852:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6702:x1875927024818432:12345-0@lo:700: 40000000:02000000:1.0:1789023533.294183:0:5852:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1789023533.301438:0:5852:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6702:x1875927024818432:12345-0@lo:700: Request processed in 32321us (32455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023533.301457:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789023533.301469:0:6702:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65de0dea00 x1875927024818432/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789023549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.301511:0:6702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6702:1875927024818432:0@lo:700: 40000000:02000000:2.0:1789023533.301524:0:6702:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:2.0:1789023533.323592:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023533.377464:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8107:x1875927024818304:12345-0@lo:700: Request processed in 108542us (108626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023533.377517:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00100000:2.0:1789023533.377557:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1789023533.377582:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00010000:00080000:2.0:1789023533.377634:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d0070a80 x1875927024818304/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789023549 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.378991:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818304:0@lo:700: 00000004:02000040:3.0:1789023533.425181:0:8107:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1789023533.433790:0:8107:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818560:0@lo:5: 00000100:00100000:3.0:1789023533.433850:0:8107:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023533.433932:0:8107:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023533.433969:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818560 00000100:00100000:0.0:1789023533.433977:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818560 00000100:00100000:0.0:1789023533.434045:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789023533.434054:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8107:x1875927024818560:12345-0@lo:5: 00002000:00080000:1.0:1789023533.445254:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789023533.445275:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1789023533.454751:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8107:x1875927024818560:12345-0@lo:5: Request processed in 20690us (20893us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789023533.454764:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789023533.458281:0:8107:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65de0dd180 x1875927024818560/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023549 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.458299:0:8107:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789023533.458316:0:8107:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e65de0dd180 x1875927024818560/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789023549 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023533.458329:0:8107:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0dd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8107:1875927024818560:0@lo:5: 00000004:00080000:2.0:1789023533.458344:0:8107:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789023534.346957:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789023534.861366:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1789023535.334793:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.335273:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006969984 00000100:00100000:3.0:1789023535.335284:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006969984 00000100:00100000:3.0:1789023535.335369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:3.0:1789023535.335377:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2360:x1875927006969984:12345-192.168.203.48@tcp:250: 00010000:00080000:3.0:1789023535.335402:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96@192.168.203.48@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:3.0:1789023535.335427:0:5840:0:(genops.c:1384:class_connect()) connect: client 6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96, cookie 0xc3c1fcbfb3417bcb 00000100:00080000:3.0:1789023535.335587:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8e65f7954800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023535.335666:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+5:2360:x1875927006969984:12345-192.168.203.48@tcp:250: Request processed in 287us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023535.335675:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:1.0:1789023535.347348:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.348228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006970112 00000100:00100000:3.0:1789023535.348240:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006970112 00000100:00100000:3.0:1789023535.348303:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:3.0:1789023535.348314:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+5:5588:x1875927006970112:12345-192.168.203.48@tcp:101: 00010000:00010000:3.0:1789023535.348344:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023535.348361:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf7da expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.348388:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.348400:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.348408:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713dc00, rc 0) 00000100:00100000:3.0:1789023535.348470:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+6:5588:x1875927006970112:12345-192.168.203.48@tcp:101: Request processed in 158us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023535.349306:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:3.0:1789023535.353330:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023535.353455:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006970240 00000100:00100000:1.0:1789023535.353464:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006970240 00000100:00100000:1.0:1789023535.353539:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:1.0:1789023535.353549:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+6:5588:x1875927006970240:12345-192.168.203.48@tcp:501: 00000100:00100000:1.0:1789023535.353858:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+6:5588:x1875927006970240:12345-192.168.203.48@tcp:501: Request processed in 310us (536us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789023535.353866:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:1.0:1789023535.360651:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.360735:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006970368 00000100:00100000:3.0:1789023535.360745:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006970368 00000100:00100000:3.0:1789023535.360794:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:3.0:1789023535.360804:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+6:5588:x1875927006970368:12345-192.168.203.48@tcp:101: 00010000:00010000:3.0:1789023535.360821:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023535.360837:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf7e1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.360863:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.360876:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.360899:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d000, rc 0) 00000100:00100000:3.0:1789023535.361000:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+7:5588:x1875927006970368:12345-192.168.203.48@tcp:101: Request processed in 196us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023535.361007:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00010000:00010000:3.0:1789023535.370832:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023535.374648:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.374965:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006970496 00000100:00100000:3.0:1789023535.374977:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006970496 00000100:00100000:3.0:1789023535.375032:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:3.0:1789023535.375042:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+7:5588:x1875927006970496:12345-192.168.203.48@tcp:501: 00000100:00100000:3.0:1789023535.375313:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5588:x1875927006970496:12345-192.168.203.48@tcp:501: Request processed in 271us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023535.375321:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:3.0:1789023535.380254:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023535.380307:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006970624 00000100:00100000:1.0:1789023535.380318:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006970624 00000100:00100000:1.0:1789023535.380374:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:1.0:1789023535.380384:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5588:x1875927006970624:12345-192.168.203.48@tcp:503: 00000100:00100000:1.0:1789023535.380879:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5588:x1875927006970624:12345-192.168.203.48@tcp:503: Request processed in 495us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023535.380889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:0.0:1789023535.384277:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.384380:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006970752 00000100:00100000:3.0:1789023535.384390:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006970752 00000100:00100000:3.0:1789023535.384440:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:3.0:1789023535.384449:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5606:x1875927006970752:12345-192.168.203.48@tcp:502: 00000100:00100000:3.0:1789023535.384813:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5606:x1875927006970752:12345-192.168.203.48@tcp:502: Request processed in 364us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023535.384822:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:1.0:1789023535.414962:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.415019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006970880 00000100:00100000:3.0:1789023535.415030:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006970880 00000100:00100000:3.0:1789023535.415110:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:3.0:1789023535.415121:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5606:x1875927006970880:12345-192.168.203.48@tcp:502: 00000100:00100000:3.0:1789023535.415377:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5606:x1875927006970880:12345-192.168.203.48@tcp:502: Request processed in 256us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023535.415393:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:0.0:1789023535.417739:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023535.417848:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971008 00000100:00100000:1.0:1789023535.417857:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971008 00000100:00100000:1.0:1789023535.417905:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:1.0:1789023535.417916:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5588:x1875927006971008:12345-192.168.203.48@tcp:101: 00010000:00010000:1.0:1789023535.418251:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023535.418269:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c1668400/0xc3c1fcbfb3417be0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf80b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023535.418295:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c1668400/0xc3c1fcbfb3417be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf80b expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023535.418307:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c1668400/0xc3c1fcbfb3417be0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf80b expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023535.418317:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c1668400, rc 0) 00000100:00100000:1.0:1789023535.418381:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5588:x1875927006971008:12345-192.168.203.48@tcp:101: Request processed in 466us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023535.418389:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:1.0:1789023535.423192:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.423249:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971136 00000100:00100000:3.0:1789023535.423257:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971136 00000100:00100000:3.0:1789023535.423301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:3.0:1789023535.423308:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5588:x1875927006971136:12345-192.168.203.48@tcp:256: 20000000:01000000:3.0:1789023535.423327:0:5838:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789023535.423347:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789023535.423349:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789023535.423351:0:5838:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789023535.423353:0:5838:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789023535.424831:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5588:x1875927006971136:12345-192.168.203.48@tcp:256: Request processed in 1517us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023535.424843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:0.0:1789023535.427026:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023535.427113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971264 00000100:00100000:3.0:1789023535.427123:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971264 00000100:00100000:3.0:1789023535.427174:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:3.0:1789023535.427193:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5588:x1875927006971264:12345-192.168.203.48@tcp:101: 00010000:00010000:3.0:1789023535.427209:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023535.427225:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf812 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.427251:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.427263:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023535.427271:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713da00, rc 0) 00000100:00100000:3.0:1789023535.427320:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5588:x1875927006971264:12345-192.168.203.48@tcp:101: Request processed in 135us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023535.427326:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:0.0:1789023535.430219:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023535.430266:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971392 00000100:00100000:0.0:1789023535.430275:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971392 00000100:00100000:0.0:1789023535.430323:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:0.0:1789023535.430333:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5588:x1875927006971392:12345-192.168.203.48@tcp:501: 00000100:00100000:0.0:1789023535.431473:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5588:x1875927006971392:12345-192.168.203.48@tcp:501: Request processed in 1139us (1258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023535.431503:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:3.0:1789023535.433027:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023535.433078:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971520 00000100:00100000:1.0:1789023535.433086:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971520 00000100:00100000:1.0:1789023535.433130:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:1.0:1789023535.433140:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5588:x1875927006971520:12345-192.168.203.48@tcp:503: 00000100:00100000:1.0:1789023535.433474:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5588:x1875927006971520:12345-192.168.203.48@tcp:503: Request processed in 333us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023535.433505:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:1.0:1789023535.439673:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023535.439705:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971648 00000100:00100000:0.0:1789023535.439715:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971648 00000100:00100000:2.0:1789023535.439778:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:2.0:1789023535.439790:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5611:x1875927006971648:12345-192.168.203.48@tcp:502: 00000100:00100000:2.0:1789023535.440042:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5611:x1875927006971648:12345-192.168.203.48@tcp:502: Request processed in 253us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023535.440050:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:0.0:1789023535.442742:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023535.442825:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971776 00000100:00100000:1.0:1789023535.442835:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971776 00000100:00100000:1.0:1789023535.442886:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:1.0:1789023535.442896:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5611:x1875927006971776:12345-192.168.203.48@tcp:502: 00000100:00100000:1.0:1789023535.443114:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5611:x1875927006971776:12345-192.168.203.48@tcp:502: Request processed in 219us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023535.443123:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:1.0:1789023535.446642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023535.446728:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006971904 00000100:00100000:2.0:1789023535.446737:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006971904 00000100:00100000:2.0:1789023535.446828:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1789023535.446837:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1875927006971904:12345-192.168.203.48@tcp:38: 00010000:00080000:2.0:1789023535.446865:0:7654:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1789023535.446911:0:7654:0:(genops.c:1384:class_connect()) connect: client fa0f4aba-40ac-42f8-b5d5-b35db811ced7, cookie 0xc3c1fcbfb3417bee 00000004:00100000:2.0:1789023535.446933:0:7654:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789023535.446938:0:7654:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789023535.495994:0:7654:0:(import.c:65:import_set_state_nolock()) ffff8e65d090a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023535.496083:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2360:x1875927006971904:12345-192.168.203.48@tcp:38: Request processed in 49244us (49472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023535.496094:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1789023536.137836:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024818688:0@lo:13: 00000100:00100000:0.0:1789023536.137914:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023536.138167:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818688 00000100:00100000:2.0:1789023536.138175:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818688 00000100:00100000:2.0:1789023536.138236:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789023536.138247:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024818688:12345-0@lo:13: 00002000:00000024:2.0:1789023536.138280:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023536.138325:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024818688:12345-0@lo:13: Request processed in 81us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023536.138332:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789023536.138501:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023536.138575:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2783b80 x1875927024818688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023552 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023536.138593:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024818688:0@lo:13: 00010000:00010000:1.0:1789023536.395556:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023536.513022:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023536.513116:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023536.514419:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972160 00000100:00100000:1.0:1789023536.514430:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972160 00000100:00100000:0.0:1789023536.514435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972032 00000100:00100000:0.0:1789023536.514443:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972032 00000100:00100000:1.0:1789023536.514575:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1789023536.514585:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:0:x1875927006972032:12345-192.168.203.48@tcp:41: 00000004:00000024:1.0:1789023536.514652:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789023536.514689:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1789023536.514702:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:5588:x1875927006972160:12345-192.168.203.48@tcp:41: 00000004:00000024:3.0:1789023536.514720:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789023536.514728:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:0:x1875927006972032:12345-192.168.203.48@tcp:41: Request processed in 143us (1610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023536.514910:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:5588:x1875927006972160:12345-192.168.203.48@tcp:41: Request processed in 53us (1739us total) trans 0 rc 0/0 00000100:00080000:2.0:1789023536.514916:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023536.514921:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1789023536.518936:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1789023536.529402:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023536.531528:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972288 00000100:00100000:0.0:1789023536.531543:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972288 00000100:00100000:0.0:1789023536.531627:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789023536.531639:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5588:x1875927006972288:12345-192.168.203.48@tcp:40: 00000100:00100000:0.0:1789023536.531737:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5588:x1875927006972288:12345-192.168.203.48@tcp:40: Request processed in 100us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023536.531744:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789023536.534650:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023536.534834:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972416 00000100:00100000:3.0:1789023536.534843:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972416 00000100:00100000:3.0:1789023536.534888:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789023536.534897:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1875927006972416:12345-192.168.203.48@tcp:8: 00010000:00080000:3.0:1789023536.534924:0:7164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:3.0:1789023536.534954:0:7164:0:(genops.c:1384:class_connect()) connect: client fa0f4aba-40ac-42f8-b5d5-b35db811ced7, cookie 0xc3c1fcbfb3417bf5 00002000:00100000:3.0:1789023536.534966:0:7164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fa0f4aba-40ac-42f8-b5d5-b35db811ced7/ffff8e65f7956000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789023536.534975:0:7164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789023536.536146:0:7164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1789023536.536580:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00080000:3.0:1789023536.536731:0:7164:0:(import.c:65:import_set_state_nolock()) ffff8e65f7956800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023536.536804:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2360:x1875927006972416:12345-192.168.203.48@tcp:8: Request processed in 1906us (2160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023536.536822:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789023536.536844:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972544 00000100:00100000:3.0:1789023536.536849:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972544 00000100:00100000:1.0:1789023536.537536:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1789023536.537544:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875927006972544:12345-192.168.203.48@tcp:8: 00010000:00080000:1.0:1789023536.537567:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp t0 exp 0000000000000000 cur 202 last 0 00000020:00000080:1.0:1789023536.537594:0:6695:0:(genops.c:1384:class_connect()) connect: client fa0f4aba-40ac-42f8-b5d5-b35db811ced7, cookie 0xc3c1fcbfb3417bfc 00002000:00100000:1.0:1789023536.537603:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fa0f4aba-40ac-42f8-b5d5-b35db811ced7/ffff8e64c13a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789023536.537635:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789023536.537938:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789023536.537961:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8e64c13a5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023536.537996:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2360:x1875927006972544:12345-192.168.203.48@tcp:8: Request processed in 451us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023536.538003:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1789023536.543318:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023536.543402:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023536.543509:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972672 00000100:00100000:1.0:1789023536.543518:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972672 00000100:00100000:1.0:1789023536.543573:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:1.0:1789023536.543583:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5588:x1875927006972672:12345-192.168.203.48@tcp:33: 00000100:00100000:3.0:1789023536.549733:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972800 00000100:00100000:3.0:1789023536.549749:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972800 00000100:00100000:3.0:1789023536.549824:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:3.0:1789023536.549834:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006972800:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1789023536.549915:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006972800:12345-192.168.203.48@tcp:400: Request processed in 82us (6606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023536.549923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 125 00000004:00080000:1.0:1789023536.564328:0:5848:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 20669us 00000004:00200000:3.0:1789023536.575061:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789023536.575164:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5588:x1875927006972672:12345-192.168.203.48@tcp:33: Request processed in 31577us (31756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023536.575179:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1789023536.763993:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023536.764085:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006972928 00000100:00100000:3.0:1789023536.764095:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006972928 00000100:00100000:3.0:1789023536.764158:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789023536.764169:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5628:x1875927006972928:12345-192.168.203.48@tcp:101: 00010000:00010000:3.0:1789023536.764196:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023536.764273:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417c03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf83c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023536.764341:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417c0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023536.764356:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023536.764372:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023536.764407:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789023536.764411:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023536.764425:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417c0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023536.764461:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417c03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf83c expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023536.764525:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417c0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf83c expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023536.764534:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65c6960800) 00010000:00010000:3.0:1789023536.764537:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789023536.764541:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d200, rc 0) 00000100:00100000:3.0:1789023536.764605:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:5628:x1875927006972928:12345-192.168.203.48@tcp:101: Request processed in 438us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023536.764612:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00010000:00010000:2.0:1789023537.417641:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023538.186263:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024818816:0@lo:400: 00000100:00100000:2.0:1789023538.186295:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024819072:0@lo:400: 00000100:00100000:3.0:1789023538.186335:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023538.186360:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023538.186409:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024819328:0@lo:400: 00000100:00100000:0.0:1789023538.186428:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024819200:0@lo:400: 00000100:00100000:1.0:1789023538.186432:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024818944:0@lo:400: 00000100:00100000:3.0:1789023538.186439:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023538.186469:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023538.186469:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023538.186512:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024819456:0@lo:400: 00000100:00100000:3.0:1789023538.186520:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819072 00000100:00100000:3.0:1789023538.186529:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819072 00000100:00100000:1.0:1789023538.186539:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023538.186540:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819328 00000100:00100000:0.0:1789023538.186546:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819328 00000100:00100000:1.0:1789023538.186574:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818816 00000100:00100000:1.0:1789023538.186577:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818816 00000100:00100000:3.0:1789023538.186587:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024818944 00000100:00100000:3.0:1789023538.186592:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024818944 00000100:00080000:2.0:1789023538.187049:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023538.187081:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819200 00000100:00100000:2.0:1789023538.187085:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819200 00000100:00100000:2.0:1789023538.187118:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819456 00000100:00100000:2.0:1789023538.187121:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819456 00000100:00100000:2.0:1789023538.187142:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023538.187150:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024819200:12345-0@lo:400: 00000100:00100000:1.0:1789023538.187252:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789023538.187259:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024818816:12345-0@lo:400: 00000100:00100000:1.0:1789023538.187310:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024818816:12345-0@lo:400: Request processed in 51us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023538.187327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789023538.187361:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023538.187368:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024819456:12345-0@lo:400: 00000100:00100000:1.0:1789023538.187403:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024819456:12345-0@lo:400: Request processed in 35us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023538.187409:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023538.187586:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024819200:12345-0@lo:400: Request processed in 435us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023538.187599:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023538.188957:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023538.188975:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024819072:12345-0@lo:400: 00000100:00100000:3.0:1789023538.189045:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024819072:12345-0@lo:400: Request processed in 78us (2686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023538.189051:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023538.189068:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789023538.189086:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024819328:12345-0@lo:400: 00000100:00100000:3.0:1789023538.189117:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024819328:12345-0@lo:400: Request processed in 32us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023538.189122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789023538.189134:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023538.189140:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024818944:12345-0@lo:400: 00000100:00100000:3.0:1789023538.189174:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024818944:12345-0@lo:400: Request processed in 35us (2707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023538.189179:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023538.189245:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024819072:0@lo:400: 00000100:00100000:1.0:1789023538.189343:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024818944:0@lo:400: 00010000:00080000:1.0:1789023538.189359:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d0070a80 x1875927024819456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023538.189369:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00080000:2.0:1789023538.189375:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023538.189382:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023538.189385:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024819456:0@lo:400: 00000100:00100000:1.0:1789023538.189423:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024819328:0@lo:400: 00000100:00100000:1.0:1789023538.189437:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024818816:0@lo:400: 00010000:00080000:2.0:1789023538.189449:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2782a00 x1875927024819200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023538.189566:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024819200:0@lo:400: 00010000:00010000:0.0:1789023538.442274:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023538.697959:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024819584:0@lo:13: 00000100:00100000:3.0:1789023538.698031:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023538.701651:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819584 00000100:00100000:2.0:1789023538.701669:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819584 00000100:00100000:2.0:1789023538.701741:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789023538.701750:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024819584:12345-0@lo:13: 00002000:00000024:2.0:1789023538.701788:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023538.701880:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024819584:12345-0@lo:13: Request processed in 132us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023538.701887:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789023538.703639:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c3800 x1875927024819584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023538.703664:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024819584:0@lo:13: 00000100:00100000:3.0:1789023538.750076:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023538.750596:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973056 00000100:00100000:0.0:1789023538.750615:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973056 00000100:00100000:0.0:1789023538.750698:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789023538.750723:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:5681:x1875927006973056:12345-192.168.203.48@tcp:41: 00000004:00000024:0.0:1789023538.750763:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789023538.750834:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:5681:x1875927006973056:12345-192.168.203.48@tcp:41: Request processed in 113us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023538.750841:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00080000:2.0:1789023538.752002:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023538.758957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023538.759042:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973184 00000100:00100000:3.0:1789023538.759051:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973184 00000100:00100000:3.0:1789023538.759121:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789023538.759132:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5681:x1875927006973184:12345-192.168.203.48@tcp:13: 00002000:00000024:3.0:1789023538.759179:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023538.759264:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5681:x1875927006973184:12345-192.168.203.48@tcp:13: Request processed in 134us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023538.759272:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00080000:2.0:1789023538.760078:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023538.762174:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023538.762430:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973312 00000100:00100000:2.0:1789023538.762441:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973312 00000100:00100000:2.0:1789023538.762533:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1789023538.762544:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5681:x1875927006973312:12345-192.168.203.48@tcp:13: 00002000:00000024:2.0:1789023538.762567:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023538.762777:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:5681:x1875927006973312:12345-192.168.203.48@tcp:13: Request processed in 234us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023538.762785:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00080000:0.0:1789023538.762982:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789023539.469210:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789023539.786521:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00010000:00010000:1.0:1789023540.489733:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789023540.815718:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000001:00100000:3.0:1789023540.863627:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000001:02000400:2.0:1789023541.087421:0:8312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1789023541.257813:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023541.257847:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024819712:0@lo:13: 00000100:00100000:2.0:1789023541.257927:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023541.259185:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819712 00000100:00100000:2.0:1789023541.259197:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819712 00000100:00100000:2.0:1789023541.259302:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789023541.259314:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024819712:12345-0@lo:13: 00002000:00000024:2.0:1789023541.259351:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023541.259413:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024819712:12345-0@lo:13: Request processed in 102us (1486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023541.259420:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789023541.259671:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1880 x1875927024819712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023541.259692:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024819712:0@lo:13: 00000100:00080000:0.0:1789023541.261207:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789023541.513697:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023541.752332:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023541.752384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023541.752410:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023541.752440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023541.752537:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973440 00000100:00100000:2.0:1789023541.752547:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973440 00000100:00100000:2.0:1789023541.752609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1789023541.752619:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2364:x1875927006973440:12345-192.168.203.48@tcp:400: 00000100:00100000:2.0:1789023541.752688:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2364:x1875927006973440:12345-192.168.203.48@tcp:400: Request processed in 70us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023541.752696:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1789023541.752842:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973568 00000100:00100000:2.0:1789023541.752846:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973568 00000100:00100000:2.0:1789023541.752883:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789023541.752890:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006973568:12345-192.168.203.48@tcp:400: 00000100:00100000:2.0:1789023541.752919:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006973568:12345-192.168.203.48@tcp:400: Request processed in 30us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023541.752938:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789023541.752958:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973696 00000100:00100000:2.0:1789023541.752961:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973696 00000100:00100000:2.0:1789023541.752985:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973824 00000100:00100000:2.0:1789023541.752988:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973824 00000100:00100000:2.0:1789023541.753008:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1789023541.753014:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006973696:12345-192.168.203.48@tcp:400: 00000100:00100000:2.0:1789023541.753039:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006973696:12345-192.168.203.48@tcp:400: Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023541.753045:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1789023541.753056:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789023541.753061:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006973824:12345-192.168.203.48@tcp:400: 00000100:00100000:2.0:1789023541.753082:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006973824:12345-192.168.203.48@tcp:400: Request processed in 21us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023541.753088:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00080000:2.0:1789023541.753208:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023541.753212:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789023541.753215:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789023542.539299:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023543.305936:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024819840:0@lo:400: 00000100:00100000:2.0:1789023543.305997:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023543.306069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819840 00000100:00100000:3.0:1789023543.306089:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819840 00000100:00100000:3.0:1789023543.306140:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789023543.306149:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024819840:12345-0@lo:400: 00000100:00100000:0.0:1789023543.306317:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024820224:0@lo:400: 00000100:00100000:0.0:1789023543.306347:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023543.306379:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024820096:0@lo:400: 00000100:00100000:0.0:1789023543.306402:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023543.306420:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789023543.306425:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024819968:0@lo:400: 00000100:00100000:0.0:1789023543.306444:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023543.306468:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024820096 00000100:00100000:0.0:1789023543.306472:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024820096 00000100:00100000:0.0:1789023543.306531:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024819968 00000100:00100000:0.0:1789023543.306535:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024819968 00000100:00100000:0.0:1789023543.306556:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023543.306561:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024820096:12345-0@lo:400: 00000100:00100000:0.0:1789023543.306607:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024820096:12345-0@lo:400: Request processed in 46us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023543.306615:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023543.306628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023543.306641:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024819968:12345-0@lo:400: 00000100:00100000:0.0:1789023543.306680:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024819968:12345-0@lo:400: Request processed in 40us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023543.306686:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023543.306722:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024819968:0@lo:400: 00000100:00100000:0.0:1789023543.306733:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024820096:0@lo:400: 00000100:00100000:3.0:1789023543.306941:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024819840:12345-0@lo:400: Request processed in 793us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023543.306948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789023543.307024:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024820224 00000100:00100000:0.0:1789023543.307029:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024820224 00000100:00100000:0.0:1789023543.307066:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023543.307074:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024820224:12345-0@lo:400: 00000100:00100000:0.0:1789023543.307112:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024820224:12345-0@lo:400: Request processed in 40us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023543.307118:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789023543.307142:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2782a00 x1875927024820224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023543.307152:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024820224:0@lo:400: 00000100:00100000:3.0:1789023543.307288:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789023543.307352:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023543.307361:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024820352:0@lo:400: 00000100:00100000:0.0:1789023543.307390:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023543.307454:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024820352 00000100:00100000:1.0:1789023543.307458:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024820352 00000100:00100000:1.0:1789023543.307514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023543.307521:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875927024820352:12345-0@lo:400: 00000100:00100000:1.0:1789023543.307555:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875927024820352:12345-0@lo:400: Request processed in 35us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023543.307581:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789023543.307748:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024820352:0@lo:400: 00000100:00100000:2.0:1789023543.308724:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024819840:0@lo:400: 00000100:00080000:2.0:1789023543.308756:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789023543.308761:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023543.310122:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024820480:0@lo:400: 00000100:00100000:3.0:1789023543.310184:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023543.310296:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024820480 00000100:00100000:2.0:1789023543.310304:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024820480 00000100:00100000:2.0:1789023543.310356:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789023543.310375:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024820480:12345-0@lo:400: 00000100:00100000:2.0:1789023543.310428:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024820480:12345-0@lo:400: Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023543.310434:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1789023543.310470:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2783800 x1875927024820480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023543.310511:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024820480:0@lo:400: 00000100:00080000:0.0:1789023543.310592:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789023543.568658:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023543.818672:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024820608:0@lo:13: 00000100:00100000:0.0:1789023543.818743:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023543.819083:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024820608 00000100:00100000:3.0:1789023543.819092:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024820608 00000100:00100000:3.0:1789023543.819148:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789023543.819158:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024820608:12345-0@lo:13: 00002000:00000024:3.0:1789023543.819194:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023543.819252:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024820608:12345-0@lo:13: Request processed in 95us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023543.819259:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1789023543.821066:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1880 x1875927024820608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023559 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023543.821112:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024820608:0@lo:13: 00000020:00000080:2.0:1789023544.240574:0:8459:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff422a8390 20000000:00000080:2.0:1789023544.240594:0:8459:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e65e7596000 uarg=0000000000000000 20000000:01000000:2.0:1789023544.240628:0:8459:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789023544.240631:0:8459:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789023544.240633:0:8459:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789023544.240638:0:8459:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789023544.240643:0:8459:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789023544.240657:0:8459:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789023544.240659:0:8459:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789023544.241149:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789023544.241152:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789023544.244702:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789023544.245579:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789023544.245635:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789023544.245872:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789023544.245888:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789023544.245891:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789023544.246848:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789023544.247232:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789023544.247296:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789023544.247336:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789023544.247351:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789023544.247353:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789023544.247988:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789023544.248410:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789023544.248456:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789023544.248593:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789023544.248610:0:8459:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789023544.248613:0:8459:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789023544.249409:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789023544.249992:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789023544.250055:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789023544.250093:0:8459:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1789023544.250109:0:8459:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789023544.250127:0:8459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250159:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250167:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250174:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250179:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250186:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250193:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250200:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250209:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250217:0:8459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250233:0:8459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250270:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250284:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 9 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250299:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024820736:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023544.250438:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250447:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 9 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250456:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024820864:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023544.250534:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250543:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 18 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250551:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024820992:0@lo:104: 00000100:00100000:2.0:1789023544.250597:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023544.250632:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250651:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250659:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821120:0@lo:104: 00000100:00100000:2.0:1789023544.250686:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023544.250711:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250720:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 18 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250728:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821248:0@lo:104: 00010000:00010000:2.0:1789023544.250751:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250759:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250767:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821376:0@lo:104: 00010000:00010000:2.0:1789023544.250790:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250797:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 18 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250804:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821504:0@lo:104: 00010000:00010000:2.0:1789023544.250826:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250844:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250853:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821632:0@lo:104: 00010000:00010000:2.0:1789023544.250879:0:8459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.250886:0:8459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 18 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.250893:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821760:0@lo:104: 00000100:00100000:2.0:1789023544.250909:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023544.251001:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789023544.251020:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023544.251048:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023544.251057:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023544.251064:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023544.251072:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023544.251080:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024820992 00000100:00100000:3.0:1789023544.251087:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024820992 00000100:00100000:3.0:1789023544.251120:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024821120 00000100:00100000:3.0:1789023544.251123:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024821120 00000100:00100000:3.0:1789023544.251134:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024821248 00000100:00100000:3.0:1789023544.251136:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024821248 00000100:00100000:3.0:1789023544.251144:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024821376 00000100:00100000:3.0:1789023544.251152:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024821376 00000100:00100000:3.0:1789023544.251164:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024821504 00000100:00100000:3.0:1789023544.251166:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024821504 00000100:00100000:3.0:1789023544.251173:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024821632 00000100:00100000:3.0:1789023544.251175:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024821632 00000100:00100000:3.0:1789023544.251182:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024821760 00000100:00100000:3.0:1789023544.251184:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024821760 00000100:00100000:3.0:1789023544.251197:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789023544.251204:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+9:8459:x1875927024820992:12345-0@lo:104: 00010000:00010000:3.0:1789023544.251217:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251267:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789023544.251273:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+9:8459:x1875927024820992:12345-0@lo:104: Request processed in 70us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023544.251279:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789023544.251296:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789023544.251302:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e778dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+8:8459:x1875927024821120:12345-0@lo:104: 00010000:00010000:3.0:1789023544.251309:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251340:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789023544.251345:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e778dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+8:8459:x1875927024821120:12345-0@lo:104: Request processed in 44us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023544.251350:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789023544.251387:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789023544.251394:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+7:8459:x1875927024821248:12345-0@lo:104: 00010000:00010000:3.0:1789023544.251402:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251446:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789023544.251452:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+7:8459:x1875927024821248:12345-0@lo:104: Request processed in 59us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023544.251457:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789023544.251470:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023544.251498:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+6:8459:x1875927024821376:12345-0@lo:104: 00010000:00010000:3.0:1789023544.251506:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251539:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789023544.251545:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+6:8459:x1875927024821376:12345-0@lo:104: Request processed in 70us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023544.251551:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023544.251574:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023544.251585:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+5:8459:x1875927024821504:12345-0@lo:104: 00010000:00010000:3.0:1789023544.251592:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251623:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789023544.251629:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+5:8459:x1875927024821504:12345-0@lo:104: Request processed in 46us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023544.251635:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023544.251646:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789023544.251651:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:8459:x1875927024821632:12345-0@lo:104: 00010000:00010000:3.0:1789023544.251658:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251694:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789023544.251698:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:8459:x1875927024821632:12345-0@lo:104: Request processed in 48us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023544.251704:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789023544.251716:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023544.251721:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:8459:x1875927024821760:12345-0@lo:104: 00010000:00010000:3.0:1789023544.251728:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251753:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789023544.251757:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:8459:x1875927024821760:12345-0@lo:104: Request processed in 37us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023544.251762:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1789023544.251779:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1789023544.251785:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251792:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c800 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023544.251796:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251804:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023544.251812:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023544.251818:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023544.251857:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251863:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023544.251884:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251891:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e713c800/0xc3c1fcbfb3417bb6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417bbd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.251895:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024821888:0@lo:103: 00010000:00010000:3.0:1789023544.251903:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1789023544.251908:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251914:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04a00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023544.251917:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251925:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023544.251932:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.251939:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1789023544.251944:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023544.251967:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.251974:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023544.251984:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.251986:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024821888 00000100:00100000:0.0:1789023544.251993:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024821888 00010000:00010000:3.0:1789023544.252006:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04a00/0xc3c1fcbfb3417b93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b9a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252016:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789023544.252019:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252027:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c1668c00 already unused, calling callback (ffffffffc1d87c20) 00010000:00010000:0.0:1789023544.252027:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 19 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023544.252032:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252045:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023544.252052:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023544.252058:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789023544.252062:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789023544.252074:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252076:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024821888:12345-0@lo:103: 00010000:00010000:3.0:1789023544.252088:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023544.252092:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023544.252099:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 19 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252104:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252116:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417b77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.252116:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 19 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252136:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789023544.252147:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.252154:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023544.252155:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04400 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023544.252160:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252167:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023544.252173:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023544.252179:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789023544.252185:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024821888:12345-0@lo:103: Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023544.252192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1789023544.252212:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252217:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024822144:0@lo:103: 00010000:00010000:3.0:1789023544.252222:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023544.252229:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252237:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04400/0xc3c1fcbfb3417b69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252247:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789023544.252252:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252258:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023544.252264:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ca00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023544.252267:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252282:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:3.0:1789023544.252285:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252290:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024822272:0@lo:103: 10000000:00010000:3.0:1789023544.252294:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023544.252306:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023544.252323:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252332:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789023544.252333:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023544.252341:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252350:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e713ca00/0xc3c1fcbfb3417b5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b62 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252362:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1789023544.252365:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822144 00010000:00010000:3.0:1789023544.252366:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252370:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822144 00010000:00010000:3.0:1789023544.252376:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023544.252379:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.252383:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 19 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252389:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023544.252398:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252402:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822272 00000100:00100000:0.0:1789023544.252407:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822272 10000000:01000000:3.0:1789023544.252413:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023544.252421:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 20 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252430:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252436:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023544.252441:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252446:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3417b31 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b38 expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252458:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023544.252461:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252465:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fce00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023544.252468:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252499:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023544.252507:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023544.252512:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789023544.252524:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252530:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023544.252548:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252555:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fce00/0xc3c1fcbfb3417b07 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b0e expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023544.252578:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023544.252580:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023544.252582:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023544.252591:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023544.252596:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023544.252601:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023544.252611:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024822016:0@lo:103: 00000100:00100000:3.0:1789023544.252640:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023544.252656:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024822528:0@lo:103: 00000100:00100000:3.0:1789023544.252674:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023544.252685:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789023544.252690:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024822400:0@lo:103: 00000100:00100000:3.0:1789023544.252708:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023544.252762:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822016 00000100:00100000:0.0:1789023544.252766:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822016 00010000:00010000:0.0:1789023544.252782:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 21 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252795:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822528 00000100:00100000:0.0:1789023544.252798:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822528 00010000:00010000:0.0:1789023544.252808:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 22 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.252821:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822400 00000100:00100000:0.0:1789023544.252823:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822400 00010000:00010000:2.0:1789023544.252829:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417bbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417bb6 expref: 23 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.252835:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 23 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.252847:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024820992:0@lo:104: 00000100:00100000:0.0:1789023544.252855:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023544.252862:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821120:0@lo:104: 00000100:00100000:0.0:1789023544.252864:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+22:3310:x1875927024822144:12345-0@lo:103: 00000100:00100000:2.0:1789023544.252876:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821248:0@lo:104: 00010000:00010000:0.0:1789023544.252880:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789023544.252885:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821376:0@lo:104: 00010000:00010000:0.0:1789023544.252888:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 22 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.252895:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821504:0@lo:104: 00000100:00100000:2.0:1789023544.252905:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821632:0@lo:104: 00010000:00010000:0.0:1789023544.252913:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 22 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.252916:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024821760:0@lo:104: 00010000:00010000:0.0:1789023544.252932:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417b7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b77 expref: 22 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.252943:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023544.252970:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+21:3310:x1875927024822144:12345-0@lo:103: Request processed in 109us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023544.252977:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023544.252994:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023544.253000:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+20:3310:x1875927024822272:12345-0@lo:103: 00010000:00010000:0.0:1789023544.253008:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023544.253013:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 20 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253022:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 20 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253032:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fda00/0xc3c1fcbfb3417b70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b69 expref: 20 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253040:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023544.253062:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024822272:12345-0@lo:103: Request processed in 62us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023544.253068:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023544.253081:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789023544.253086:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+18:3313:x1875927024822016:12345-0@lo:103: 00010000:00010000:0.0:1789023544.253100:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023544.253104:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253112:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253121:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3417b9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b93 expref: 18 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253130:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023544.253219:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+17:3313:x1875927024822016:12345-0@lo:103: Request processed in 132us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023544.253225:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789023544.253237:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023544.253243:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3313:x1875927024822528:12345-0@lo:103: 00010000:00010000:0.0:1789023544.253250:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023544.253255:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253262:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253271:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713d600/0xc3c1fcbfb3417b38 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b31 expref: 16 pid: 5839 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253279:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023544.253299:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c12300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+15:3313:x1875927024822528:12345-0@lo:103: Request processed in 56us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023544.253304:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023544.253322:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023544.253333:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+14:3313:x1875927024822400:12345-0@lo:103: 00010000:00010000:0.0:1789023544.253340:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023544.253345:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 14 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253352:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 14 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253361:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c1668800/0xc3c1fcbfb3417b62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b5b expref: 14 pid: 5840 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.253369:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023544.253390:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3313:x1875927024822400:12345-0@lo:103: Request processed in 58us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023544.253395:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023544.253416:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023544.253770:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024821888:0@lo:103: 00000100:00100000:0.0:1789023544.255026:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024822656:0@lo:103: 00000100:00100000:3.0:1789023544.255663:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024822400:0@lo:103: 00000100:00100000:3.0:1789023544.255673:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024822016:0@lo:103: 00000100:00100000:3.0:1789023544.255680:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024822528:0@lo:103: 00000100:00100000:2.0:1789023544.255839:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024822272:0@lo:103: 00000100:00100000:2.0:1789023544.255874:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024822144:0@lo:103: 00000100:00100000:0.0:1789023544.255890:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023544.255920:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822656 00000100:00100000:2.0:1789023544.255997:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822656 00010000:00010000:2.0:1789023544.256029:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 13 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.256062:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789023544.256069:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c8134050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:3311:x1875927024822656:12345-0@lo:103: 00010000:00010000:2.0:1789023544.256081:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023544.256086:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 13 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.256095:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 13 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.256111:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04600/0xc3c1fcbfb3417b0e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b07 expref: 13 pid: 5838 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.256124:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023544.256168:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c8134050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:3311:x1875927024822656:12345-0@lo:103: Request processed in 100us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023544.256175:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023544.256214:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024822656:0@lo:103: 00000100:00100000:1.0:1789023544.257281:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023544.257361:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023544.257421:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024820736:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023544.257430:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8459:1875927024820864:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023544.257471:0:8459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.261725:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006973952 00000100:00100000:0.0:1789023544.261740:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006973952 00010000:00010000:0.0:1789023544.261788:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 10 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023544.261828:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974080 00000100:00100000:0.0:1789023544.261832:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974080 00000100:00100000:2.0:1789023544.261837:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00010000:00010000:0.0:1789023544.261847:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 11 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.261868:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:2362:x1875927006973952:12345-192.168.203.48@tcp:103: 00000100:00100000:0.0:1789023544.261872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00010000:00010000:2.0:1789023544.261885:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789023544.261892:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:2362:x1875927006974080:12345-192.168.203.48@tcp:103: 00010000:00010000:2.0:1789023544.261894:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 11 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.261904:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023544.261909:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 11 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.261913:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 11 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.262038:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713dc00/0xc3c1fcbfb3417bd2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7da expref: 11 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262044:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 11 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023544.262056:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023544.262062:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713d000/0xc3c1fcbfb3417bd9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf7e1 expref: 10 pid: 5839 timeout: 310 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262075:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262084:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262100:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262108:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262115:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262123:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262131:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fc400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023544.262135:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262158:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262173:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262185:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023544.262207:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:2362:x1875927006974080:12345-192.168.203.48@tcp:103: Request processed in 319us (4846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023544.262215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00010000:00010000:0.0:1789023544.262621:0:8459:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262630:0:8459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023544.262637:0:8459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc400/0xc3c1fcbfb3417c11 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023544.262821:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:2362:x1875927006973952:12345-192.168.203.48@tcp:103: Request processed in 260us (4843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023544.262832:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00010000:00010000:0.0:1789023544.586611:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023545.609701:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789023546.125360:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789023546.125368:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65fc5ee000 from 39 10000000:01000000:2.0:1789023546.125373:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023546.125417:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.125428:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.125438:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023546.125458:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024822784:0@lo:101: 00000100:00100000:2.0:1789023546.125567:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.125642:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324840 going to sleep for 11 seconds 00000100:00100000:1.0:1789023546.125722:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822784 00000100:00100000:1.0:1789023546.125730:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822784 00000100:00100000:1.0:1789023546.125783:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789023546.125794:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+12:5843:x1875927024822784:12345-0@lo:101: 00010000:00010000:1.0:1789023546.125806:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023546.125884:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c1669200/0xc3c1fcbfb3417c1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.125908:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c1669200/0xc3c1fcbfb3417c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c18 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.125919:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c1669200/0xc3c1fcbfb3417c1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c18 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.125928:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c1669200, rc 0) 00000100:00100000:1.0:1789023546.126253:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024822784:12345-0@lo:101: Request processed in 462us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023546.126260:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789023546.126326:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024822784:0@lo:101: 00010000:00010000:2.0:1789023546.126339:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.126349:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023546.126401:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024822912:0@lo:501: 00000100:00100000:2.0:1789023546.126428:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.126542:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324840 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.126608:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024822912 00000100:00100000:3.0:1789023546.126613:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024822912 00000100:00100000:3.0:1789023546.126651:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789023546.126668:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024822912:12345-0@lo:501: 00000100:00100000:3.0:1789023546.126920:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024822912:12345-0@lo:501: Request processed in 254us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.126928:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789023546.127004:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024822912:0@lo:501: 00000100:00100000:2.0:1789023546.127030:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823040:0@lo:503: 00000100:00100000:2.0:1789023546.127065:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.127085:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324840 going to sleep for 11 seconds 00000100:00100000:0.0:1789023546.127170:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823040 00000100:00100000:0.0:1789023546.127176:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823040 00000100:00100000:0.0:1789023546.127206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789023546.127214:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024823040:12345-0@lo:503: 00000100:00100000:0.0:1789023546.127679:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024823040:12345-0@lo:503: Request processed in 466us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023546.127686:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789023546.127745:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823040:0@lo:503: 00000100:00100000:1.0:1789023546.128449:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8477:1875927024823168:0@lo:502: 00000100:00100000:1.0:1789023546.128507:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.128545:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.128607:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823168 00000100:00100000:3.0:1789023546.128612:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823168 00000100:00100000:3.0:1789023546.128646:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789023546.128653:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:8477:x1875927024823168:12345-0@lo:502: 00000100:00100000:3.0:1789023546.128830:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+13:8477:x1875927024823168:12345-0@lo:502: Request processed in 178us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.128836:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789023546.128909:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8477:1875927024823168:0@lo:502: 00000100:00100000:0.0:1789023546.128950:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8477:1875927024823296:0@lo:502: 00000100:00100000:0.0:1789023546.128978:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023546.129002:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d237c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023546.129079:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823296 00000100:00100000:1.0:1789023546.129084:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823296 00000100:00100000:1.0:1789023546.129111:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789023546.129117:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:8477:x1875927024823296:12345-0@lo:502: 00000100:00100000:1.0:1789023546.129244:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:8477:x1875927024823296:12345-0@lo:502: Request processed in 127us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023546.129250:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789023546.129317:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8477:1875927024823296:0@lo:502: 00000040:00080000:0.0:1789023546.129336:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789023546.129636:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789023546.129655:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789023546.129664:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.129674:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023546.129683:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789023546.129686:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1789023546.129689:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789023546.129711:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.129719:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.129728:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.129741:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823424:0@lo:101: 00000100:00100000:1.0:1789023546.129767:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.129803:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.129965:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823424 00000100:00100000:2.0:1789023546.129970:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823424 00000100:00100000:2.0:1789023546.130003:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789023546.130010:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+13:5843:x1875927024823424:12345-0@lo:101: 00010000:00010000:2.0:1789023546.130018:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023546.130029:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb3417c2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.130048:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb3417c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c26 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.130058:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb3417c2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c26 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.130072:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fd600, rc 0) 00000100:00100000:2.0:1789023546.130109:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024823424:12345-0@lo:101: Request processed in 100us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.130115:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789023546.130241:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823424:0@lo:101: 00010000:00010000:1.0:1789023546.130253:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.130262:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.130301:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823552:0@lo:501: 00000100:00100000:1.0:1789023546.130325:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.130348:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.130401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823552 00000100:00100000:3.0:1789023546.130406:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823552 00000100:00100000:3.0:1789023546.130436:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789023546.130443:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024823552:12345-0@lo:501: 00000100:00100000:3.0:1789023546.130693:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024823552:12345-0@lo:501: Request processed in 250us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.130699:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789023546.130870:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823552:0@lo:501: 00000100:00100000:1.0:1789023546.130896:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823680:0@lo:503: 00000100:00100000:1.0:1789023546.130930:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.130989:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023546.131068:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823680 00000100:00100000:0.0:1789023546.131073:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823680 00000100:00100000:0.0:1789023546.131103:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789023546.131110:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024823680:12345-0@lo:503: 00000100:00100000:0.0:1789023546.131329:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024823680:12345-0@lo:503: Request processed in 218us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023546.131335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789023546.131418:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024823680:0@lo:503: 00000100:00100000:2.0:1789023546.133102:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8478:1875927024823808:0@lo:502: 00000100:00100000:2.0:1789023546.133169:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.133254:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324600 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.136999:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823808 00000100:00100000:3.0:1789023546.137013:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823808 00000100:00100000:3.0:1789023546.137146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789023546.137157:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8478:x1875927024823808:12345-0@lo:502: 00000100:00100000:3.0:1789023546.137426:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8478:x1875927024823808:12345-0@lo:502: Request processed in 270us (4255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.137439:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789023546.137574:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8478:1875927024823808:0@lo:502: 00000020:01000000:0.0:1789023546.137609:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023546.137618:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023546.137621:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789023546.137626:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789023546.137660:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8478:1875927024823936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023546.137701:0:8478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.138322:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024823936 00000100:00100000:2.0:1789023546.138329:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024823936 00000100:00100000:0.0:1789023546.138348:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d237c480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.138363:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789023546.138370:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8478:x1875927024823936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.138928:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+14:8478:x1875927024823936:12345-0@lo:502:llog_process_th.0 Request processed in 558us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.138936:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789023546.140098:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8478:1875927024823936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023546.140134:0:8478:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023546.140142:0:8478:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023546.140144:0:8478:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789023546.140148:0:8478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789023546.140360:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789023546.140381:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789023546.140391:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.140401:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023546.140410:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789023546.140412:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65d089d800 from 39 10000000:01000000:1.0:1789023546.140415:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789023546.140442:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.140458:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.140467:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.140571:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.140672:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.140699:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.140905:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824064 00000100:00100000:2.0:1789023546.140912:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824064 00000100:00100000:2.0:1789023546.140992:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789023546.141002:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+14:5843:x1875927024824064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023546.141013:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023546.141026:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417c3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.141047:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c34 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.141058:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417c3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c34 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.141073:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fd800, rc 0) 00000100:00100000:2.0:1789023546.141119:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024824064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.141125:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789023546.141188:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023546.141200:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.141208:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.141251:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.141275:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.141653:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.142028:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824192 00000100:00100000:3.0:1789023546.142034:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824192 00000100:00100000:3.0:1789023546.142069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789023546.142076:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024824192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023546.142322:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024824192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 245us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.142329:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789023546.142449:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.142526:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.142574:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.142667:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.142812:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824320 00000100:00100000:3.0:1789023546.142817:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824320 00000100:00100000:0.0:1789023546.142913:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789023546.142929:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024824320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023546.143078:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024824320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023546.143085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789023546.143470:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.143909:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8479:1875927024824448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023546.143955:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.144019:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.144053:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824448 00000100:00100000:2.0:1789023546.144058:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824448 00000100:00100000:2.0:1789023546.144118:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789023546.144135:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8479:x1875927024824448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.144345:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8479:x1875927024824448:12345-0@lo:502:llog_process_th.0 Request processed in 218us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.144352:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789023546.144430:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8479:1875927024824448:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023546.144494:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8479:1875927024824576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023546.144523:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.144542:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.144658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824576 00000100:00100000:2.0:1789023546.144662:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824576 00000100:00100000:2.0:1789023546.144685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789023546.144691:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8479:x1875927024824576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.144811:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:8479:x1875927024824576:12345-0@lo:502:llog_process_th.0 Request processed in 119us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.144818:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789023546.149473:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8479:1875927024824576:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789023546.149538:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789023546.150874:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789023546.150902:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789023546.150912:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.150924:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023546.150952:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789023546.150954:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789023546.150957:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789023546.150990:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.150997:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.151006:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023546.151027:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.151085:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.151247:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324600 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.153505:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824704 00000100:00100000:3.0:1789023546.153519:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824704 00000100:00100000:3.0:1789023546.153587:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789023546.153597:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+15:5843:x1875927024824704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023546.153612:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023546.153627:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713ca00/0xc3c1fcbfb3417c49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c42 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023546.153653:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713ca00/0xc3c1fcbfb3417c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c42 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023546.153663:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713ca00/0xc3c1fcbfb3417c49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c42 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023546.153672:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713ca00, rc 0) 00000100:00100000:3.0:1789023546.153741:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024824704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.153748:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789023546.154641:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023546.154663:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.154673:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023546.154743:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.154794:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.154829:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324600 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.155001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824832 00000100:00100000:3.0:1789023546.155020:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824832 00000100:00100000:3.0:1789023546.155062:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789023546.155070:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024824832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023546.155442:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024824832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 372us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.155449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789023546.155562:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.155599:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.155638:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.155697:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789023546.156997:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024824960 00000100:00100000:0.0:1789023546.157007:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024824960 00000100:00100000:0.0:1789023546.157051:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789023546.157060:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024824960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023546.157265:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024824960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 206us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023546.157272:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789023546.158691:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024824960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.163772:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8480:1875927024825088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023546.163866:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.163907:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023546.167905:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825088 00000100:00100000:0.0:1789023546.167920:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825088 00000100:00100000:0.0:1789023546.167981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789023546.167991:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8480:x1875927024825088:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023546.168396:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8480:x1875927024825088:12345-0@lo:502:llog_process_th.0 Request processed in 406us (4530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023546.168404:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789023546.169650:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8480:1875927024825088:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789023546.169873:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023546.169883:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023546.169885:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789023546.169890:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789023546.169929:0:8480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8480:1875927024825216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023546.169987:0:8480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.170029:0:8480:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.170039:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825216 00000100:00100000:2.0:1789023546.170045:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825216 00000100:00100000:2.0:1789023546.170100:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789023546.170110:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8480:x1875927024825216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.170306:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:8480:x1875927024825216:12345-0@lo:502:llog_process_th.0 Request processed in 197us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.170314:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789023546.171681:0:8480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8480:1875927024825216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789023546.171716:0:8480:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023546.171729:0:8480:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023546.171732:0:8480:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789023546.171737:0:8480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1789023546.171979:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1789023546.171998:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789023546.172006:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.172014:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023546.172020:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789023546.172022:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65d252c800 from 39 10000000:01000000:2.0:1789023546.172024:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789023546.172054:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.172060:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023546.172239:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023546.172256:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.172294:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.172316:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023546.184721:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825344 00000100:00100000:0.0:1789023546.184734:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825344 00000100:00100000:1.0:1789023546.184948:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789023546.184959:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024825344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023546.184973:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023546.184990:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c1668000/0xc3c1fcbfb3417c57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c50 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.185015:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c1668000/0xc3c1fcbfb3417c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c50 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.185024:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c1668000/0xc3c1fcbfb3417c57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c50 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.185032:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c1668000, rc 0) 00000100:00100000:1.0:1789023546.185107:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024825344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (12808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023546.185113:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789023546.185443:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023546.186308:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023546.186323:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023546.188266:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.189059:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.189121:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.189212:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825472 00000100:00100000:3.0:1789023546.189220:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825472 00000100:00100000:3.0:1789023546.189269:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789023546.189277:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024825472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023546.189573:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024825472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 296us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.189588:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789023546.189677:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c12680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.189714:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.189775:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.189796:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324600 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.190277:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825600 00000100:00100000:3.0:1789023546.190282:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825600 00000100:00100000:3.0:1789023546.190354:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789023546.190362:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024825600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023546.190538:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024825600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.190551:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1789023546.190647:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.191239:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8481:1875927024825728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.191276:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.191877:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023546.192082:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825728 00000100:00100000:1.0:1789023546.192089:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825728 00000100:00100000:1.0:1789023546.192119:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789023546.192137:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8481:x1875927024825728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023546.192340:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8481:x1875927024825728:12345-0@lo:502:llog_process_th.0 Request processed in 214us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023546.192347:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789023546.194958:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8481:1875927024825728:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.195101:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8481:1875927024825856:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.195166:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.195260:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2287780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.195363:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825856 00000100:00100000:3.0:1789023546.195370:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825856 00000100:00100000:2.0:1789023546.195647:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789023546.195657:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8481:x1875927024825856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.195900:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8481:x1875927024825856:12345-0@lo:502:llog_process_th.0 Request processed in 244us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.195908:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789023546.195981:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8481:1875927024825856:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789023546.196014:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789023546.197192:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789023546.197218:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789023546.197228:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.197251:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023546.197261:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789023546.197264:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789023546.197266:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789023546.197294:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.197303:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.197312:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.197336:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.197382:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.197421:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789023546.197645:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024825984 00000100:00100000:0.0:1789023546.197652:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024825984 00000100:00100000:0.0:1789023546.197696:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789023546.197704:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024825984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023546.197724:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023546.197736:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417c65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c5e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023546.197767:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c5e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023546.197776:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417c65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c5e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023546.197784:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04000, rc 0) 00000100:00100000:0.0:1789023546.197823:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024825984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023546.197829:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789023546.198140:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024825984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023546.198154:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.198163:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.198210:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.198234:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.198259:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa240 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.198426:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024826112 00000100:00100000:2.0:1789023546.198430:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024826112 00000100:00100000:2.0:1789023546.198454:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789023546.198465:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024826112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023546.198787:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024826112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.198803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789023546.198829:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.198857:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.198892:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.198963:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa240 going to sleep for 11 seconds 00000100:00100000:3.0:1789023546.199084:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024826240 00000100:00100000:3.0:1789023546.199089:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024826240 00000100:00100000:3.0:1789023546.199120:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789023546.199214:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024826240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023546.199393:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024826240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.199408:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789023546.199811:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023546.200226:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8482:1875927024826368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023546.200262:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023546.200326:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.200362:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024826368 00000100:00100000:2.0:1789023546.200366:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024826368 00000100:00100000:2.0:1789023546.200497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789023546.200506:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8482:x1875927024826368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.200694:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8482:x1875927024826368:12345-0@lo:502:llog_process_th.0 Request processed in 190us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.200700:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789023546.200774:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8482:1875927024826368:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023546.200795:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023546.200804:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023546.200806:0:8482:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789023546.200812:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789023546.200836:0:8482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8482:1875927024826496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023546.200866:0:8482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023546.201338:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024826496 00000100:00100000:0.0:1789023546.201343:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024826496 00000100:00100000:3.0:1789023546.201353:0:8482:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73223c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023546.201387:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789023546.201394:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8482:x1875927024826496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023546.201710:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8482:x1875927024826496:12345-0@lo:502:llog_process_th.0 Request processed in 316us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.201761:0:8482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8482:1875927024826496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023546.201785:0:8482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023546.201794:0:8482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023546.201796:0:8482:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789023546.201800:0:8482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000100:00100000:2.0:1789023546.202142:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000020:01000000:1.0:1789023546.202251:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1789023546.202268:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789023546.202278:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.202287:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023546.202296:0:5843:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789023546.202298:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e65d2720000 from 1 10000000:01000000:1.0:1789023546.202301:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789023546.202323:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.202331:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.202339:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.202353:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.202380:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.202422:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d08fa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789023546.202430:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024826624 00000100:00100000:0.0:1789023546.202435:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024826624 00000100:00100000:0.0:1789023546.202526:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789023546.202645:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024826624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023546.202653:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023546.202663:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c1669a00/0xc3c1fcbfb3417c73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c6c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.202678:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c1669a00/0xc3c1fcbfb3417c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c6c expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.202685:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c1669a00/0xc3c1fcbfb3417c73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c6c expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023546.202690:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c1669a00, rc 0) 00000100:00100000:1.0:1789023546.202717:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024826624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023546.202723:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789023546.202866:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023546.202880:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023546.202888:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023546.202929:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023546.202952:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023546.203082:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024826752 00000100:00100000:0.0:1789023546.203084:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d237ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023546.203086:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024826752 00000100:00100000:1.0:1789023546.203146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789023546.203154:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024826752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023546.203394:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024826752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (436us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789023546.203403:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024826752:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1789023546.203423:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789023546.203428:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023546.203436:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023546.203460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789023546.380447:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024826880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023546.380541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023546.380736:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024826880 00000100:00100000:2.0:1789023546.380744:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024826880 00000100:00100000:2.0:1789023546.380808:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789023546.380819:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024826880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023546.380850:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023546.380896:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024826880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.381026:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789023546.381048:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789023546.381078:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c0a80 x1875927024826880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023562 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023546.381097:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024826880:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789023546.635444:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023546.861210:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023546.861256:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023546.861294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023546.861351:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023546.861386:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974592 00000100:00100000:2.0:1789023546.861397:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974592 00000100:00100000:2.0:1789023546.861466:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974464 00000100:00100000:2.0:1789023546.861469:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974464 00000100:00080000:1.0:1789023546.861513:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023546.861523:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023546.861527:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023546.861539:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006974592:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1789023546.861542:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789023546.861569:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006974464:12345-192.168.203.48@tcp:400: 00000100:00100000:3.0:1789023546.861646:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974208 00000100:00100000:3.0:1789023546.861651:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974208 00000100:00100000:0.0:1789023546.861720:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974336 00000100:00100000:0.0:1789023546.861724:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974336 00000100:00100000:0.0:1789023546.861760:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789023546.861767:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006974336:12345-192.168.203.48@tcp:400: 00000100:00100000:1.0:1789023546.862207:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006974464:12345-192.168.203.48@tcp:400: Request processed in 642us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023546.862215:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789023546.862337:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:3.0:1789023546.862349:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:2363:x1875927006974208:12345-192.168.203.48@tcp:400: 00000100:00100000:2.0:1789023546.864095:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006974592:12345-192.168.203.48@tcp:400: Request processed in 2551us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023546.864107:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00080000:2.0:1789023546.864196:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023546.864243:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006974336:12345-192.168.203.48@tcp:400: Request processed in 2472us (3039us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023546.864254:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:3.0:1789023546.868727:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:2363:x1875927006974208:12345-192.168.203.48@tcp:400: Request processed in 6369us (7420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023546.868742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00010000:00010000:3.0:1789023547.658269:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023548.426225:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024827392:0@lo:400:kworker.0 00000100:00100000:2.0:1789023548.426290:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023548.426354:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023548.426361:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024827264:0@lo:400:kworker.0 00000100:00100000:2.0:1789023548.426385:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023548.426427:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827264 00000100:00100000:2.0:1789023548.426435:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827264 00000100:00100000:2.0:1789023548.426513:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789023548.426524:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024827264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023548.426584:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024827264:12345-0@lo:400:kworker.0 Request processed in 62us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023548.426591:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789023548.426614:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023548.426640:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024827264:0@lo:400:kworker.0 00000100:00100000:1.0:1789023548.426722:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827392 00000100:00100000:1.0:1789023548.426726:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827392 00000100:00100000:1.0:1789023548.426768:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023548.426777:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024827392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023548.426817:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024827392:12345-0@lo:400:kworker.0 Request processed in 42us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023548.426823:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1789023548.426868:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1c00 x1875927024827392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023548.426880:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024827392:0@lo:400:kworker.0 00000100:00080000:2.0:1789023548.427382:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023548.427450:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024827136:0@lo:400:kworker.0 00000100:00100000:3.0:1789023548.427510:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023548.427547:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024827648:0@lo:400:kworker.0 00000100:00100000:3.0:1789023548.427570:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023548.427606:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789023548.427613:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024827008:0@lo:400:kworker.0 00000100:00100000:3.0:1789023548.427639:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023548.427657:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024827520:0@lo:400:kworker.0 00000100:00100000:3.0:1789023548.427676:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023548.427819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827136 00000100:00100000:2.0:1789023548.427852:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827136 00000100:00100000:2.0:1789023548.427881:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827520 00000100:00100000:2.0:1789023548.427884:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827520 00000100:00100000:2.0:1789023548.427908:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023548.427915:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024827136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023548.427989:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827648 00000100:00100000:1.0:1789023548.427993:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827648 00000100:00100000:1.0:1789023548.428021:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789023548.428028:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024827648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023548.428313:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827008 00000100:00100000:0.0:1789023548.428318:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827008 00000100:00100000:0.0:1789023548.428347:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789023548.428354:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024827008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023548.433559:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024827136:12345-0@lo:400:kworker.0 Request processed in 5624us (6026us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023548.433575:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023548.433610:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789023548.433622:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024827520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023548.433670:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024827520:12345-0@lo:400:kworker.0 Request processed in 53us (5993us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023548.433676:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789023548.433845:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023548.433851:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023548.436365:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024827648:12345-0@lo:400:kworker.0 Request processed in 8329us (8786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023548.436379:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789023548.436588:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024827520:0@lo:400:kworker.0 00000100:00100000:3.0:1789023548.436602:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024827136:0@lo:400:kworker.0 00010000:00080000:3.0:1789023548.436615:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c2680 x1875927024827648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023564 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023548.436625:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024827648:0@lo:400:kworker.0 00000100:00100000:0.0:1789023548.437046:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024827008:12345-0@lo:400:kworker.0 Request processed in 8690us (9403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023548.437055:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789023548.437145:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024827008:0@lo:400:kworker.0 00010000:00010000:0.0:1789023548.681654:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023548.939727:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023548.939751:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024827776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023548.939817:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023548.940075:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827776 00000100:00100000:2.0:1789023548.940083:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827776 00000100:00100000:2.0:1789023548.940133:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023548.940142:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024827776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023548.940172:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023548.940223:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024827776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023548.940230:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789023548.940306:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1500 x1875927024827776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023564 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023548.940325:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024827776:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789023549.707839:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023549.934104:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023549.934213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974720 00000100:00100000:3.0:1789023549.934238:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974720 00000100:00100000:3.0:1789023549.934312:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:3.0:1789023549.934323:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:5602:x1875927006974720:12345-192.168.203.48@tcp:101: 00010000:00010000:3.0:1789023549.934346:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023549.934382:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713c800/0xc3c1fcbfb3417c7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf843 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023549.934410:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713c800/0xc3c1fcbfb3417c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf843 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023549.934420:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713c800/0xc3c1fcbfb3417c7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf843 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023549.934429:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c800, rc 0) 00000100:00100000:3.0:1789023549.934526:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5602:x1875927006974720:12345-192.168.203.48@tcp:101: Request processed in 205us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023549.934548:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:1.0:1789023549.940620:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023549.940752:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974848 00000100:00100000:0.0:1789023549.940762:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974848 00000100:00100000:0.0:1789023549.940815:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:0.0:1789023549.940826:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5602:x1875927006974848:12345-192.168.203.48@tcp:501: 00000100:00100000:0.0:1789023549.941175:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5602:x1875927006974848:12345-192.168.203.48@tcp:501: Request processed in 349us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023549.941184:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:1.0:1789023549.951327:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023549.951561:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006974976 00000100:00100000:2.0:1789023549.951572:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006974976 00000100:00100000:2.0:1789023549.951627:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:2.0:1789023549.951637:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5602:x1875927006974976:12345-192.168.203.48@tcp:503: 00000100:00100000:2.0:1789023549.951862:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5602:x1875927006974976:12345-192.168.203.48@tcp:503: Request processed in 225us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023549.951870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:1.0:1789023549.960362:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023549.972947:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006975104 00000100:00100000:3.0:1789023549.972963:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006975104 00000100:00100000:2.0:1789023549.980979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:2.0:1789023549.980993:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:6099:x1875927006975104:12345-192.168.203.48@tcp:502: 00000100:00100000:2.0:1789023549.981876:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:6099:x1875927006975104:12345-192.168.203.48@tcp:502: Request processed in 881us (21519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023549.981902:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:1.0:1789023549.987927:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023549.988423:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006975232 00000100:00100000:0.0:1789023549.988434:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006975232 00000100:00100000:0.0:1789023549.988521:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:0.0:1789023549.988541:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:6099:x1875927006975232:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789023549.989022:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:6099:x1875927006975232:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 491us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023549.989031:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:1.0:1789023549.999218:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023550.002006:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006975360 00000100:00100000:2.0:1789023550.002020:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006975360 00000100:00100000:2.0:1789023550.002099:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:2.0:1789023550.002110:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5602:x1875927006975360:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023550.002124:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023550.002141:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fce00/0xc3c1fcbfb3417c81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf84a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023550.002170:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fce00/0xc3c1fcbfb3417c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf84a expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023550.002182:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fce00/0xc3c1fcbfb3417c81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf84a expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023550.002192:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fce00, rc 0) 00000100:00100000:2.0:1789023550.002600:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006975360:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 490us (3390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023550.002607:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:0.0:1789023550.008831:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023550.009074:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006975488 00000100:00100000:2.0:1789023550.009147:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006975488 00000100:00100000:2.0:1789023550.009300:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 169 00000100:00100000:2.0:1789023550.009312:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006975488:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023550.009963:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006975488:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 651us (1137us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023550.009973:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 169 00010000:00010000:3.0:1789023550.733303:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023551.497759:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024827904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023551.497828:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023551.497907:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024827904 00000100:00100000:2.0:1789023551.497915:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024827904 00000100:00100000:2.0:1789023551.498067:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789023551.498086:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024827904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023551.498119:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023551.498172:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024827904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023551.498179:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789023551.498255:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1f80 x1875927024827904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023551.498273:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024827904:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789023551.498782:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789023551.752860:0:8522:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe05de25a0 20000000:00000080:0.0:1789023551.752881:0:8522:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e65f6f27800 uarg=0000000000000000 20000000:01000000:0.0:1789023551.752918:0:8522:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789023551.752924:0:8522:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789023551.752929:0:8522:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00010000:00010000:3.0:1789023551.753834:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789023551.755691:0:8523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789023551.756644:0:8522:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789023551.764026:0:8522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789023551.764405:0:8522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789023551.764606:0:8522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789023551.764624:0:8522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789023551.764642:0:8522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.764658:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fd400/0xc3c1fcbfb3417a51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.764665:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.764671:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.764679:0:8522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.764685:0:8522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.764927:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.764956:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 9 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.764971:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828032:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023551.765373:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.765393:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 18 pid: 5838 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.765403:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828160:0@lo:104: 00000100:00100000:1.0:1789023551.765448:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789023551.765511:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.765530:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 18 pid: 5839 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.765539:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828288:0@lo:104: 00000100:00100000:1.0:1789023551.765561:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023551.765592:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789023551.765604:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024828160 00000100:00100000:1.0:1789023551.765610:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024828160 00000100:00100000:1.0:1789023551.765645:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024828288 00000100:00100000:1.0:1789023551.765648:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024828288 00000100:00100000:1.0:1789023551.765663:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789023551.765670:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+4:8522:x1875927024828160:12345-0@lo:104: 00010000:00010000:1.0:1789023551.765682:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.765748:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023551.765755:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+4:8522:x1875927024828160:12345-0@lo:104: Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.765761:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789023551.765777:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789023551.765784:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de205850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+3:8522:x1875927024828288:12345-0@lo:104: 00010000:00010000:1.0:1789023551.765791:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.765820:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789023551.765825:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de205850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+3:8522:x1875927024828288:12345-0@lo:104: Request processed in 43us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.765830:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1789023551.765872:0:8522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fd400/0xc3c1fcbfb3417a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.765880:0:8522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fd400/0xc3c1fcbfb3417a51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 18 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.765888:0:8522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828416:0@lo:104: 00000100:00100000:1.0:1789023551.765907:0:8522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023551.765926:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024828416 00000100:00100000:1.0:1789023551.765930:0:5828:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024828416 00000100:00100000:1.0:1789023551.765947:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789023551.765951:0:5828:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+3:8522:x1875927024828416:12345-0@lo:104: 00010000:00010000:1.0:1789023551.765959:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.765995:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789023551.765999:0:5828:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+3:8522:x1875927024828416:12345-0@lo:104: Request processed in 48us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.766005:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789023551.766022:0:8522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f0107e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023551.766041:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828160:0@lo:104: 00000100:00100000:1.0:1789023551.766047:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828288:0@lo:104: 00000100:00100000:1.0:1789023551.766053:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c59f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828416:0@lo:104: 00010000:00010000:1.0:1789023551.766091:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789023551.766096:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766103:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04800 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023551.766107:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766114:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023551.766121:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023551.766126:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789023551.766150:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766157:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023551.766173:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766185:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04800/0xc3c1fcbfb3417b23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417b2a expref: -99 pid: 7637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766197:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023551.766200:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766205:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fc000 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023551.766208:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766214:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023551.766219:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023551.766223:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789023551.766234:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766240:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023551.766245:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766251:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc000/0xc3c1fcbfb3417ac1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417acf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766259:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023551.766266:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766272:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05c00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023551.766274:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766280:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023551.766286:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023551.766290:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789023551.766303:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766309:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023551.766322:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766328:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb3417a4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417a51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766343:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023551.766345:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023551.766347:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023551.766365:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024828800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023551.766390:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023551.766431:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024828544:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023551.766460:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023551.766502:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023551.766508:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024828672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023551.766541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023551.766570:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024828800 00000100:00100000:1.0:1789023551.766574:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024828800 00010000:00010000:1.0:1789023551.766590:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fd400/0xc3c1fcbfb3417a51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 19 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.766608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024828544 00000100:00100000:1.0:1789023551.766611:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024828544 00010000:00010000:1.0:1789023551.766619:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 20 pid: 5838 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.766628:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024828672 00000100:00100000:1.0:1789023551.766630:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024828672 00010000:00010000:1.0:1789023551.766640:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 21 pid: 5839 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.766651:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789023551.766657:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+21:3310:x1875927024828800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023551.766665:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023551.766671:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fd400/0xc3c1fcbfb3417a51 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 21 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766680:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fd400/0xc3c1fcbfb3417a51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 21 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766691:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fd400/0xc3c1fcbfb3417a51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417a4a expref: 21 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766711:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023551.766738:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+20:3310:x1875927024828800:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.766744:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789023551.766758:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023551.766763:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024828544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023551.766771:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023551.766775:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 19 pid: 5838 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766783:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 19 pid: 5838 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766793:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417b2a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417b23 expref: 19 pid: 5838 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766801:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023551.766826:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:3312:x1875927024828544:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.766831:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023551.766843:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789023551.766848:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:3312:x1875927024828672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023551.766855:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023551.766858:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 17 pid: 5839 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766864:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 17 pid: 5839 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766879:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e6602166c00/0xc3c1fcbfb3417acf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417ac1 expref: 17 pid: 5839 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.766888:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023551.766908:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3312:x1875927024828672:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.766913:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789023551.766944:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024828800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023551.766963:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024828672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023551.766969:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024828544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023551.767756:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023551.767777:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023551.773982:0:8522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8522:1875927024828032:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023551.774016:0:8522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023551.778036:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023551.778121:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006975616 00000100:00100000:1.0:1789023551.778129:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006975616 00010000:00010000:1.0:1789023551.778163:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023551.778200:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:1.0:1789023551.778210:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2362:x1875927006975616:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023551.778227:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023551.778233:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778245:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778279:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3417be7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf812 expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778294:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778302:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778319:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778326:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778333:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778340:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778347:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023551.778351:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778360:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778376:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023551.778407:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023551.778466:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:2362:x1875927006975616:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 257us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.778474:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00010000:00010000:3.0:1789023551.779036:0:8522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023551.779046:0:8522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023551.779053:0:8522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e707e600/0xc3c1fcbfb3417c88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023551.982709:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023551.982757:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023551.983711:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023551.983801:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006975872 00000100:00100000:1.0:1789023551.983813:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006975872 00000100:00100000:1.0:1789023551.983866:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976000 00000100:00100000:1.0:1789023551.983869:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976000 00000100:00100000:1.0:1789023551.983892:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789023551.983901:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006975872:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023551.983963:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006975872:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 63us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.983969:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789023551.983985:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1789023551.983991:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006976000:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023551.984013:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006976000:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023551.984019:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00080000:1.0:1789023551.984037:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023551.984041:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023551.984649:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006975744 00000100:00100000:2.0:1789023551.984655:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006975744 00000100:00100000:2.0:1789023551.984705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:2.0:1789023551.984715:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006975744:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023551.984750:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006975744:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023551.984757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00080000:1.0:1789023551.988793:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789023552.777856:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023553.545810:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024828928:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.545893:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.545938:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024829440:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.545962:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.546006:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023553.546012:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024829312:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546038:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.546079:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024829184:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546102:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.546118:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789023553.546124:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024829056:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546144:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.546160:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024829568:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546179:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.546241:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829440 00000100:00100000:1.0:1789023553.546250:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829440 00000100:00100000:1.0:1789023553.546296:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829184 00000100:00100000:1.0:1789023553.546299:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829184 00000100:00100000:1.0:1789023553.546314:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829056 00000100:00100000:1.0:1789023553.546316:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829056 00000100:00100000:1.0:1789023553.546330:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023553.546338:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024829440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546384:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024829440:12345-0@lo:400:kworker.0 Request processed in 46us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023553.546391:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023553.546404:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789023553.546411:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024829184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546438:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024829184:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023553.546444:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789023553.546455:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789023553.546467:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024829056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546524:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024829056:12345-0@lo:400:kworker.0 Request processed in 58us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023553.546529:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789023553.546546:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829312 00000100:00100000:1.0:1789023553.546549:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829312 00000100:00100000:1.0:1789023553.546571:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829568 00000100:00100000:1.0:1789023553.546573:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829568 00000100:00100000:1.0:1789023553.546591:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789023553.546597:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024829312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546627:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024829312:12345-0@lo:400:kworker.0 Request processed in 30us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023553.546632:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789023553.546642:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789023553.546648:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024829568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546676:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024829568:12345-0@lo:400:kworker.0 Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023553.546682:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789023553.546768:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023553.546772:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023553.546774:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023553.546799:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c0000 x1875927024829312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023553.546812:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024829312:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546822:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024829440:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546848:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024829056:0@lo:400:kworker.0 00010000:00080000:1.0:1789023553.546867:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1c00 x1875927024829568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023553.546876:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024829568:0@lo:400:kworker.0 00000100:00100000:1.0:1789023553.546885:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024829184:0@lo:400:kworker.0 00000100:00100000:2.0:1789023553.548226:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024828928 00000100:00100000:2.0:1789023553.548237:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024828928 00000100:00100000:2.0:1789023553.548289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789023553.548298:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3311:x1875927024828928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023553.548381:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3311:x1875927024828928:12345-0@lo:400:kworker.0 Request processed in 84us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.548388:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1789023553.548440:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024828928:0@lo:400:kworker.0 10000000:01000000:1.0:1789023553.610601:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789023553.610609:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65fc5ee000 from 4 10000000:01000000:1.0:1789023553.610614:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789023553.610659:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023553.610670:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023553.610682:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023553.610715:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024829696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023553.610789:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.610834:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.610952:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829696 00000100:00100000:2.0:1789023553.610960:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829696 00000100:00100000:2.0:1789023553.611005:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789023553.611015:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024829696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023553.611027:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023553.611040:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c8f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.611071:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.611083:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.611092:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fc000, rc 0) 00000100:00100000:2.0:1789023553.611141:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024829696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.611147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1789023553.611335:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024829696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023553.611350:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023553.611360:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023553.611441:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024829824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023553.611514:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.611536:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.611587:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829824 00000100:00100000:2.0:1789023553.611592:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829824 00000100:00100000:2.0:1789023553.611619:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789023553.611625:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024829824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.611864:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024829824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.611877:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789023553.612193:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024829824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023553.612224:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024829952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023553.612263:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023553.612292:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023553.612379:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024829952 00000100:00100000:3.0:1789023553.612384:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024829952 00000100:00100000:3.0:1789023553.612421:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789023553.612429:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024829952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.612600:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024829952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.612607:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789023553.612649:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024829952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.612858:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8592:1875927024830080:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023553.612897:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023553.612915:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830080 00000100:00100000:3.0:1789023553.612919:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830080 00000100:00100000:3.0:1789023553.612939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789023553.612945:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8592:x1875927024830080:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023553.613054:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8592:x1875927024830080:12345-0@lo:502:llog_process_th.0 Request processed in 109us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.613072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789023553.613100:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d781dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023553.613112:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8592:1875927024830080:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023553.613132:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023553.613141:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023553.613143:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789023553.613150:0:8592:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65fc5ee000 00000020:00000080:3.0:1789023553.613152:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789023553.613211:0:8592:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8592:1875927024830208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023553.613241:0:8592:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023553.613257:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830208 00000100:00100000:3.0:1789023553.613261:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830208 00000100:00100000:3.0:1789023553.613280:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789023553.613285:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8592:x1875927024830208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023553.613381:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:8592:x1875927024830208:12345-0@lo:502:llog_process_th.0 Request processed in 95us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.613388:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789023553.613422:0:8592:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d781dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023553.613434:0:8592:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8592:1875927024830208:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023553.613460:0:8592:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023553.613464:0:8592:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023553.613466:0:8592:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789023553.613469:0:8592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789023553.613556:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789023553.613571:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789023553.613578:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023553.613588:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023553.613598:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789023553.613601:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d089d800 from 4 10000000:01000000:3.0:1789023553.613604:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789023553.613624:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023553.613632:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023553.613641:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023553.613654:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.613678:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023553.613691:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d781dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023553.613702:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830336 00000100:00100000:3.0:1789023553.613706:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830336 00000100:00100000:3.0:1789023553.613727:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789023553.613733:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024830336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023553.613747:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023553.613759:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417c9d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023553.613777:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023553.613786:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023553.613793:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c200, rc 0) 00000100:00100000:3.0:1789023553.613820:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024830336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.613826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789023553.613854:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023553.613865:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023553.613873:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023553.613906:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.613928:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023553.613940:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d781dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023553.613951:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830464 00000100:00100000:3.0:1789023553.613954:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830464 00000100:00100000:3.0:1789023553.613972:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789023553.613977:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024830464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.614162:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024830464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 184us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.614170:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789023553.614199:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.614222:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.614256:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023553.614269:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d781dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023553.614279:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830592 00000100:00100000:3.0:1789023553.614283:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830592 00000100:00100000:3.0:1789023553.614302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789023553.614307:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024830592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.614407:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024830592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.614413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789023553.614447:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.621796:0:8593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8593:1875927024830720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023553.621878:0:8593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023553.621912:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830720 00000100:00100000:2.0:1789023553.621919:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830720 00000100:00100000:2.0:1789023553.621958:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789023553.621966:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8593:x1875927024830720:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023553.622159:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8593:x1875927024830720:12345-0@lo:502:llog_process_th.0 Request processed in 193us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.622166:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789023553.622217:0:8593:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c6d49000 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.622236:0:8593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8593:1875927024830720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023553.622263:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023553.622270:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023553.622272:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789023553.622278:0:8593:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65d089d800 00000020:00000080:2.0:1789023553.622280:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789023553.622355:0:8593:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8593:1875927024830848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023553.622403:0:8593:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023553.622432:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830848 00000100:00100000:2.0:1789023553.622436:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830848 00000100:00100000:2.0:1789023553.622457:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789023553.622464:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8593:x1875927024830848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023553.622600:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:8593:x1875927024830848:12345-0@lo:502:llog_process_th.0 Request processed in 135us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.622616:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789023553.622644:0:8593:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.622656:0:8593:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8593:1875927024830848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023553.622674:0:8593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023553.622678:0:8593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023553.622680:0:8593:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789023553.622683:0:8593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789023553.622730:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789023553.622747:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023553.622756:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.622766:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023553.622776:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789023553.622778:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d252c800 from 4 10000000:01000000:2.0:1789023553.622781:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789023553.622802:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.622809:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.622818:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023553.622831:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.622855:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023553.622874:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.622889:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024830976 00000100:00100000:2.0:1789023553.622892:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024830976 00000100:00100000:2.0:1789023553.622912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789023553.622918:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024830976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023553.622926:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023553.622937:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417cab expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.622956:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.622966:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.622974:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fc600, rc 0) 00000100:00100000:2.0:1789023553.623002:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024830976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.623008:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1789023553.623035:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024830976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023553.623045:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.623054:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023553.623091:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024831104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.623115:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023553.623137:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.623149:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024831104 00000100:00100000:2.0:1789023553.623152:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024831104 00000100:00100000:2.0:1789023553.623192:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789023553.623199:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024831104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.623391:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024831104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.623398:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789023553.623427:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024831104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.623449:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024831232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.623499:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023553.623523:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.623535:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024831232 00000100:00100000:2.0:1789023553.623538:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024831232 00000100:00100000:2.0:1789023553.623555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789023553.623559:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024831232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.623657:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024831232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.623664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789023553.623699:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024831232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023553.631607:0:8595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8595:1875927024831360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023553.631690:0:8595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023553.631727:0:8595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d237ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023553.631837:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024831360 00000100:00100000:2.0:1789023553.631844:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024831360 00000100:00100000:2.0:1789023553.631888:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789023553.631896:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:8595:x1875927024831360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023553.632087:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:8595:x1875927024831360:12345-0@lo:502:llog_process_th.0 Request processed in 191us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.632101:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789023553.633888:0:8595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8595:1875927024831360:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023553.633932:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023553.633943:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023553.633945:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789023553.633954:0:8595:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65d252c800 00000020:00000080:0.0:1789023553.633957:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789023553.634043:0:8595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8595:1875927024831488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023553.634102:0:8595:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023553.634141:0:8595:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d237ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023553.641637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024831488 00000100:00100000:3.0:1789023553.641652:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024831488 00000100:00100000:3.0:1789023553.641718:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789023553.641729:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:8595:x1875927024831488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023553.641988:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:8595:x1875927024831488:12345-0@lo:502:llog_process_th.0 Request processed in 260us (7885us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.641997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789023553.643673:0:8595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:8595:1875927024831488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789023553.643714:0:8595:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023553.643723:0:8595:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023553.643725:0:8595:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789023553.643730:0:8595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:1.0:1789023553.649294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023553.649336:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976128 00000100:00100000:1.0:1789023553.649346:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976128 00000100:00100000:1.0:1789023553.649398:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:1.0:1789023553.649407:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:5602:x1875927006976128:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023553.649423:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023553.649440:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf851 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023553.649465:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023553.649495:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023553.649513:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e000, rc 0) 00000100:00100000:1.0:1789023553.649568:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006976128:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 162us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023553.649575:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 186 00000020:01000000:2.0:1789023553.650140:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789023553.650163:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023553.650172:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023553.650180:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023553.658223:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023553.662438:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976256 00000100:00100000:3.0:1789023553.662450:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976256 00000100:00100000:3.0:1789023553.662531:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:3.0:1789023553.662549:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006976256:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023553.662826:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006976256:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 279us (4611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023553.662834:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:3.0:1789023553.673081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023553.676443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976384 00000100:00100000:2.0:1789023553.676459:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976384 00000100:00100000:2.0:1789023553.676550:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:2.0:1789023553.676560:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006976384:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023553.676776:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:5602:x1875927006976384:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 216us (3702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.676784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:3.0:1789023553.686192:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023553.690015:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976512 00000100:00100000:0.0:1789023553.690030:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976512 00000100:00100000:0.0:1789023553.690094:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:0.0:1789023553.690104:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:6163:x1875927006976512:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789023553.690325:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:6163:x1875927006976512:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 222us (4142us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023553.690334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:2.0:1789023553.697039:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023553.697080:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976640 00000100:00100000:2.0:1789023553.697088:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976640 00000100:00100000:2.0:1789023553.697133:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:2.0:1789023553.697143:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:6163:x1875927006976640:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789023553.697370:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:6163:x1875927006976640:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 228us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023553.697379:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 190 00010000:00010000:0.0:1789023553.802327:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023554.060784:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024831616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023554.060854:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023554.061497:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024831616 00000100:00100000:3.0:1789023554.061514:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024831616 00000100:00100000:3.0:1789023554.061562:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789023554.061670:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024831616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023554.061703:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023554.061750:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024831616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023554.061756:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789023554.061790:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c11180 x1875927024831616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023570 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023554.061807:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024831616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023554.829203:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023555.850572:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023556.618739:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023556.618760:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024831744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023556.618824:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023556.618893:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024831744 00000100:00100000:3.0:1789023556.618902:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024831744 00000100:00100000:3.0:1789023556.618975:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023556.618985:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024831744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023556.619019:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023556.619069:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024831744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023556.619076:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789023556.619124:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1500 x1875927024831744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023572 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023556.619142:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024831744:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789023556.621018:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789023556.875548:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023557.107430:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023557.107470:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023557.107528:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023557.107542:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977024 00000100:00100000:2.0:1789023557.107553:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977024 00000100:00100000:1.0:1789023557.107558:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023557.107584:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976896 00000100:00100000:1.0:1789023557.107591:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976896 00000100:00100000:2.0:1789023557.107614:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977152 00000100:00100000:2.0:1789023557.107620:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977152 00000100:00100000:1.0:1789023557.107644:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:2.0:1789023557.107654:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1789023557.107659:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006976896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023557.107668:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006977024:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023557.107762:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006976768 00000100:00100000:0.0:1789023557.107767:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006976768 00000100:00100000:0.0:1789023557.107816:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:0.0:1789023557.107824:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006976768:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023557.107866:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006977024:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023557.107874:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:2.0:1789023557.107891:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789023557.107897:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006977152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023557.110349:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006976896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 2685us (2810us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023557.110363:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:0.0:1789023557.115657:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006976768:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 7813us (8216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023557.115682:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00080000:1.0:1789023557.116142:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023557.116151:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789023557.116156:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023557.119890:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006977152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 11979us (12320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023557.119908:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00010000:00010000:0.0:1789023557.900995:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789023557.915729:0:8822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1789023558.665743:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024832128:0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.665822:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023558.665894:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789023558.665900:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024832000:0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.665921:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023558.665939:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024832512:0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.665961:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023558.665992:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832128 00000100:00100000:2.0:1789023558.666012:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832128 00000100:00100000:2.0:1789023558.666060:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832000 00000100:00100000:2.0:1789023558.666064:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832000 00000100:00100000:2.0:1789023558.666085:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789023558.666093:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024832128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.666142:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024832128:12345-0@lo:400:kworker.0 Request processed in 49us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023558.666149:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789023558.666165:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789023558.666171:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024832000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.666198:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024832000:12345-0@lo:400:kworker.0 Request processed in 27us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023558.666203:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789023558.666225:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832512 00000100:00100000:2.0:1789023558.666228:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832512 00000100:00100000:2.0:1789023558.666257:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789023558.666264:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024832512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.666292:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024832512:12345-0@lo:400:kworker.0 Request processed in 29us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023558.666298:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1789023558.666314:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023558.666318:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023558.666352:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024832000:0@lo:400:kworker.0 00010000:00080000:2.0:1789023558.666365:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c3800 x1875927024832512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023558.666389:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024832512:0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.666410:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024832128:0@lo:400:kworker.0 00000100:00100000:3.0:1789023558.666695:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024831872:0@lo:400:kworker.0 00000100:00100000:3.0:1789023558.666731:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023558.666762:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024832384:0@lo:400:kworker.0 00000100:00100000:3.0:1789023558.666793:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023558.666818:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023558.666824:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024832256:0@lo:400:kworker.0 00000100:00100000:3.0:1789023558.666843:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023558.666868:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832256 00000100:00100000:3.0:1789023558.666872:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832256 00000100:00100000:3.0:1789023558.666902:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789023558.666908:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024832256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023558.666946:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024832256:12345-0@lo:400:kworker.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023558.666953:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789023558.666979:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1180 x1875927024832256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023574 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023558.666988:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024832256:0@lo:400:kworker.0 00000100:00100000:0.0:1789023558.667094:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832384 00000100:00100000:0.0:1789023558.667099:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832384 00000100:00100000:0.0:1789023558.667132:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789023558.667139:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024832384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023558.667178:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024832384:12345-0@lo:400:kworker.0 Request processed in 40us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023558.667184:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789023558.667211:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024832384:0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.667891:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024831872 00000100:00100000:2.0:1789023558.667896:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024831872 00000100:00100000:2.0:1789023558.667931:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789023558.667938:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024831872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023558.667988:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024831872:12345-0@lo:400:kworker.0 Request processed in 51us (1256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023558.667995:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:2.0:1789023558.668026:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023558.668030:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023558.668127:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024831872:0@lo:400:kworker.0 00010000:00010000:1.0:1789023558.921957:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023559.181869:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023559.181890:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024832640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023559.181962:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023559.182018:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832640 00000100:00100000:0.0:1789023559.182025:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832640 00000100:00100000:0.0:1789023559.182069:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023559.182077:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024832640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023559.182110:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023559.182150:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024832640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023559.182156:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789023559.182205:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f40ebb80 x1875927024832640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023575 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023559.182223:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40ebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024832640:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023559.946740:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023560.972533:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023561.737707:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024832768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023561.737790:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023561.737927:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832768 00000100:00100000:3.0:1789023561.737935:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832768 00000100:00100000:3.0:1789023561.737991:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789023561.737999:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024832768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023561.738139:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023561.738183:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024832768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023561.738190:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1789023561.738256:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c11500 x1875927024832768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023577 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023561.738281:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024832768:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789023561.738439:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789023561.997202:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023562.241047:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023562.241090:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023562.241157:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977408 00000100:00100000:3.0:1789023562.241166:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977408 00000100:00100000:3.0:1789023562.241232:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00080000:1.0:1789023562.241471:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023562.241541:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006977408:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023562.241616:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006977408:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 81us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023562.241623:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:2.0:1789023562.242104:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977280 00000100:00100000:2.0:1789023562.242111:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977280 00000100:00100000:2.0:1789023562.242153:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:2.0:1789023562.242162:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006977280:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023562.242207:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006977280:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 47us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023562.242214:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:1.0:1789023562.247585:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023562.247611:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023562.247708:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977536 00000100:00100000:2.0:1789023562.247718:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977536 00000100:00100000:2.0:1789023562.247775:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977664 00000100:00100000:2.0:1789023562.247779:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977664 00000100:00100000:2.0:1789023562.247801:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023562.247811:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2360:x1875927006977536:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:2.0:1789023562.247845:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417bf5 00000100:00080000:2.0:1789023562.247854:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8e65f7956800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789023562.247888:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789023562.248197:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+2:2360:x1875927006977536:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 388us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023562.248205:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023562.248218:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789023562.248225:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2360:x1875927006977664:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:2.0:1789023562.248237:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417bfc 00000100:00080000:2.0:1789023562.248243:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8e64c13a5000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789023562.248261:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789023562.248819:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+2:2360:x1875927006977664:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 593us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023562.248827:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00010000:00010000:2.0:1789023562.248903:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023562.248910:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789023562.249236:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023562.249241:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789023563.019366:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023563.222155:0:9066:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing yml_node 00000100:00100000:1.0:1789023563.785820:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024833280:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.785885:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023563.785937:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789023563.785943:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024832896:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.785972:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023563.785995:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024833408:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786018:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023563.786042:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024833024:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786063:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023563.786079:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024833536:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786098:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023563.786113:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023563.786118:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024833152:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786136:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023563.786167:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024832896 00000100:00100000:1.0:1789023563.786172:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024832896 00000100:00100000:1.0:1789023563.786211:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789023563.786219:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024832896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786267:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024832896:12345-0@lo:400:kworker.0 Request processed in 48us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023563.786281:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789023563.786312:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833408 00000100:00100000:1.0:1789023563.786316:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833408 00000100:00100000:1.0:1789023563.786345:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833024 00000100:00100000:1.0:1789023563.786348:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833024 00000100:00100000:1.0:1789023563.786359:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833152 00000100:00100000:1.0:1789023563.786362:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833152 00000100:00100000:1.0:1789023563.786376:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789023563.786381:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024833408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786411:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2246d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024833408:12345-0@lo:400:kworker.0 Request processed in 30us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023563.786418:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789023563.786429:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023563.786434:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024833024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786500:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024833024:12345-0@lo:400:kworker.0 Request processed in 43us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023563.786506:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023563.786517:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789023563.786523:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024833152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786577:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024833152:12345-0@lo:400:kworker.0 Request processed in 53us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023563.786584:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789023563.786606:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023563.786631:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2244380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024833152:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786640:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2247480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024833024:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786673:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2244a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024832896:0@lo:400:kworker.0 00000100:00100000:1.0:1789023563.786683:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2247b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024833408:0@lo:400:kworker.0 00000100:00100000:2.0:1789023563.786754:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833280 00000100:00100000:2.0:1789023563.786759:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833280 00000100:00100000:2.0:1789023563.786802:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833536 00000100:00100000:2.0:1789023563.786806:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833536 00000100:00100000:2.0:1789023563.786827:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023563.786834:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024833280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023563.786875:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024833280:12345-0@lo:400:kworker.0 Request processed in 42us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023563.786881:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023563.786892:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789023563.786898:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024833536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023563.786926:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024833536:12345-0@lo:400:kworker.0 Request processed in 30us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023563.786932:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789023563.786974:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e64c2246300 x1875927024833536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023563.786983:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024833536:0@lo:400:kworker.0 00010000:00080000:2.0:1789023563.787001:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e64c2246680 x1875927024833280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023579 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023563.787009:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2246680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024833280:0@lo:400:kworker.0 00000100:00080000:1.0:1789023563.787052:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023563.787055:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789023564.041587:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023564.299806:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024833664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023564.299876:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023564.299984:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833664 00000100:00100000:3.0:1789023564.299993:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833664 00000100:00100000:3.0:1789023564.300041:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789023564.300052:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024833664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023564.300086:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023564.300131:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024833664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023564.300137:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789023564.300306:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c11500 x1875927024833664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023580 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023564.300325:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024833664:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789023565.065782:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789023565.365136:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:2.0:1789023565.365145:0:6722:0:(genops.c:885:class_export_put()) final put ffff8e65f7956000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:3.0:1789023565.367507:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f7956000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 for lustre-OST0000 00000020:00000080:3.0:1789023565.374229:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65f7956800 for lustre-OST0000 00010000:00010000:2.0:1789023566.090009:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789023566.451834:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:3.0:1789023566.451843:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e64c13a0000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:0.0:1789023566.451936:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c13a0000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 for lustre-OST0001 00000020:00000080:0.0:1789023566.451987:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e64c13a5000 for lustre-OST0001 00000100:00100000:2.0:1789023566.858726:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024833792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023566.858795:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023566.858976:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833792 00000100:00100000:3.0:1789023566.858985:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833792 00000100:00080000:1.0:1789023566.859142:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023566.859263:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789023566.859274:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024833792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023566.859308:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023566.859375:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024833792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023566.859382:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789023566.859460:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c10000 x1875927024833792/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023582 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023566.859504:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024833792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789023567.118622:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023567.343219:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023567.343395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023567.345494:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977920 00000100:00100000:1.0:1789023567.345508:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977920 00000100:00100000:1.0:1789023567.345599:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:1.0:1789023567.345611:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006977920:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023567.345688:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006977920:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 79us (2292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023567.345696:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789023567.347285:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006977792 00000100:00100000:3.0:1789023567.347298:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006977792 00000100:00100000:3.0:1789023567.347347:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:3.0:1789023567.347556:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006977792:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023567.347787:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006977792:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 432us (4579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023567.347795:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00080000:2.0:1789023567.349698:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789023568.138538:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023568.907761:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024833920:0@lo:400:kworker.0 00000100:00100000:0.0:1789023568.907852:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023568.908024:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024834304:0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.908062:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023568.908153:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024833920 00000100:00100000:2.0:1789023568.908164:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024833920 00000100:00100000:1.0:1789023568.908202:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024834048:0@lo:400:kworker.0 00000100:00100000:2.0:1789023568.908216:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1789023568.908227:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024833920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.908233:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023568.908254:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023568.908259:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024834176:0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.908277:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023568.908309:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834048 00000100:00100000:1.0:1789023568.908313:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834048 00000100:00100000:1.0:1789023568.908357:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834176 00000100:00100000:1.0:1789023568.908361:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834176 00000100:00100000:1.0:1789023568.908418:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789023568.908426:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024834048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.908464:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024834048:12345-0@lo:400:kworker.0 Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023568.908470:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789023568.908504:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789023568.908510:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024834176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.908538:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024834176:12345-0@lo:400:kworker.0 Request processed in 28us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023568.908544:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789023568.908590:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024834176:0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.908601:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024834048:0@lo:400:kworker.0 00000100:00100000:3.0:1789023568.909183:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834304 00000100:00100000:3.0:1789023568.909189:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834304 00000100:00100000:3.0:1789023568.909232:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789023568.909239:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024834304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023568.909284:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024834304:12345-0@lo:400:kworker.0 Request processed in 45us (1222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023568.909290:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1789023568.909320:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789023568.909324:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023568.909591:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023568.909605:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024834560:0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.909642:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789023568.909702:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c13b80 x1875927024834304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023568.909716:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024834304:0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.909730:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023568.909736:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024834432:0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.909759:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023568.909787:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834432 00000100:00100000:1.0:1789023568.909791:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834432 00000100:00100000:1.0:1789023568.909838:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789023568.909845:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024834432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023568.909881:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024834432:12345-0@lo:400:kworker.0 Request processed in 37us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023568.909887:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789023568.909903:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023568.909918:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024834432:0@lo:400:kworker.0 00000100:00100000:2.0:1789023568.910331:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024833920:12345-0@lo:400:kworker.0 Request processed in 2104us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023568.910341:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789023568.910743:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834560 00000100:00100000:3.0:1789023568.910757:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834560 00000100:00080000:2.0:1789023568.910835:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789023568.910893:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023568.910902:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024834560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023568.910968:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024834560:12345-0@lo:400:kworker.0 Request processed in 68us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023568.910975:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789023568.911134:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c11f80 x1875927024834560/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023568.911153:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024834560:0@lo:400:kworker.0 00000100:00100000:0.0:1789023568.911787:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024833920:0@lo:400:kworker.0 00000001:02000400:0.0:1789023568.965437:0:9261:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00010000:00010000:1.0:1789023569.167610:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023569.422193:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024834688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023569.422298:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023569.422410:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834688 00000100:00100000:0.0:1789023569.422421:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834688 00000100:00100000:0.0:1789023569.422506:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023569.422517:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024834688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023569.422566:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023569.422744:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024834688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 228us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023569.422754:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789023569.422810:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f40e8000 x1875927024834688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023585 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023569.422836:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024834688:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789023570.185900:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789023571.177593:0:9358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00010000:00010000:0.0:1789023571.209973:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023571.978890:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023571.978913:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024834816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023571.978976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023571.979373:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834816 00000100:00100000:3.0:1789023571.979389:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834816 00000100:00100000:3.0:1789023571.979453:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789023571.979463:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024834816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023571.979525:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023571.979574:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024834816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (597us total) trans 0 rc 0/0 00000100:00080000:2.0:1789023571.979656:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789023571.979686:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c10a80 x1875927024834816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023587 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023571.979703:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024834816:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023571.979830:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1789023572.238010:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023572.460282:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023572.460326:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023572.460602:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978176 00000100:00100000:0.0:1789023572.460612:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978176 00000100:00100000:1.0:1789023572.460751:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978048 00000100:00100000:1.0:1789023572.460756:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978048 00000100:00100000:1.0:1789023572.460793:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 197 00000100:00100000:1.0:1789023572.460802:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006978048:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023572.460866:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2363:x1875927006978048:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 64us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023572.460874:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 197 00000100:00100000:0.0:1789023572.461036:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1789023572.461058:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006978176:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023572.461100:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006978176:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 56us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023572.461120:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00080000:2.0:1789023572.461374:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789023573.262032:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023573.834677:0:9455:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:1.0:1789023574.028273:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024835328:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.028365:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023574.028453:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789023574.028461:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024834944:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.028516:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023574.028569:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024835456:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.028596:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023574.028625:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024835072:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.028668:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023574.028689:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024835584:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.030184:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023574.030343:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835456 00000100:00100000:0.0:1789023574.030358:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835456 00000100:00100000:0.0:1789023574.030440:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835072 00000100:00100000:0.0:1789023574.030444:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835072 00000100:00100000:0.0:1789023574.030469:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789023574.030497:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024835456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023574.030575:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2246300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024835456:12345-0@lo:400:kworker.0 Request processed in 97us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023574.030582:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789023574.030600:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789023574.030606:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024835072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023574.030631:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024835072:12345-0@lo:400:kworker.0 Request processed in 26us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023574.030637:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789023574.030731:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2244700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024835072:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.030753:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023574.030764:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024835200:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.030791:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023574.030818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835200 00000100:00100000:1.0:1789023574.030821:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835200 00000100:00100000:1.0:1789023574.030842:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789023574.030848:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024835200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.030878:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024835200:12345-0@lo:400:kworker.0 Request processed in 30us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023574.030883:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789023574.031027:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024835456:0@lo:400:kworker.0 00000100:00100000:1.0:1789023574.031048:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024835200:0@lo:400:kworker.0 00000100:00100000:3.0:1789023574.034466:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024834944 00000100:00100000:3.0:1789023574.034501:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024834944 00000100:00100000:3.0:1789023574.034594:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789023574.034608:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024834944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023574.034732:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024834944:12345-0@lo:400:kworker.0 Request processed in 128us (6214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023574.034740:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789023574.034814:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2246a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024834944:0@lo:400:kworker.0 00000100:00100000:2.0:1789023574.036715:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835328 00000100:00100000:2.0:1789023574.036730:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835328 00000100:00100000:2.0:1789023574.036797:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835584 00000100:00100000:2.0:1789023574.036800:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835584 00000100:00100000:2.0:1789023574.036840:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789023574.036853:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024835328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023574.036970:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2246680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024835328:12345-0@lo:400:kworker.0 Request processed in 121us (8605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023574.036977:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789023574.036994:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789023574.037001:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024835584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023574.037035:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcde300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024835584:12345-0@lo:400:kworker.0 Request processed in 35us (6859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023574.037057:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1789023574.037106:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e64c2245c00 x1875927024835328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023574.037121:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024835328:0@lo:400:kworker.0 00010000:00080000:2.0:1789023574.037164:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e64c2244000 x1875927024835584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023574.037174:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2244000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024835584:0@lo:400:kworker.0 00000100:00080000:0.0:1789023574.037328:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023574.037333:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789023574.037336:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789023574.281682:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023574.537923:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023574.537956:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024835712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023574.538063:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023574.538269:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835712 00000100:00100000:1.0:1789023574.538279:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835712 00000100:00100000:1.0:1789023574.538346:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789023574.538358:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024835712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023574.538416:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023574.538506:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024835712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023574.538533:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789023574.538551:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcded80 x1875927024835712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023574.538576:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024835712:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789023575.155749:0:9504:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 02:59:33 EDT 2026 00010000:00010000:1.0:1789023575.306418:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023576.329992:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023577.097797:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023577.097821:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024835840:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023577.097884:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023577.098047:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835840 00000100:00100000:3.0:1789023577.098055:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835840 00000100:00100000:3.0:1789023577.098119:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789023577.098129:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024835840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023577.098162:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023577.098207:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024835840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023577.098214:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789023577.098255:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c10a80 x1875927024835840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023577.098273:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024835840:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789023577.098878:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789023577.367077:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023577.581727:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023577.581760:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978432 00000100:00100000:3.0:1789023577.581779:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978432 00000100:00100000:3.0:1789023577.581835:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789023577.581845:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927006978432:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023577.581920:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927006978432:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 76us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023577.581928:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00080000:3.0:1789023577.581949:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023577.590718:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023577.599430:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978304 00000100:00100000:2.0:1789023577.599452:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978304 00000100:00100000:2.0:1789023577.599552:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:2.0:1789023577.599563:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2361:x1875927006978304:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023577.599632:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2361:x1875927006978304:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 72us (8924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023577.599640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 199 00010000:00010000:2.0:1789023578.379998:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023579.146935:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023579.147658:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024835968:0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.147703:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024836224:0@lo:400:kworker.0 00000100:00100000:0.0:1789023579.147731:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023579.147738:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024836480:0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.147748:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023579.147783:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023579.147792:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789023579.147795:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024836352:0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.147802:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024836096:0@lo:400:kworker.0 00000100:00100000:0.0:1789023579.147830:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023579.147842:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023579.147845:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024835968 00000100:00100000:3.0:1789023579.147853:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024835968 00000100:00100000:2.0:1789023579.147881:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024836608:0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.147905:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023579.148034:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789023579.148053:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024835968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023579.148099:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024835968:12345-0@lo:400:kworker.0 Request processed in 54us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023579.148105:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789023579.148180:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836224 00000100:00100000:2.0:1789023579.148185:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836224 00000100:00100000:2.0:1789023579.148217:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836480 00000100:00100000:2.0:1789023579.148219:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836480 00000100:00100000:2.0:1789023579.148231:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836096 00000100:00100000:2.0:1789023579.148232:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836096 00000100:00100000:2.0:1789023579.148243:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789023579.148248:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024836224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.148283:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024836224:12345-0@lo:400:kworker.0 Request processed in 34us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023579.148288:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789023579.148299:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789023579.148304:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024836480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.148328:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024836480:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023579.148343:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789023579.148354:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789023579.148359:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024836096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.148384:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024836096:12345-0@lo:400:kworker.0 Request processed in 25us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023579.148390:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789023579.148408:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836352 00000100:00100000:2.0:1789023579.148411:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836352 00000100:00100000:2.0:1789023579.148434:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836608 00000100:00100000:2.0:1789023579.148436:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836608 00000100:00100000:2.0:1789023579.148454:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789023579.148466:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024836352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.148518:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024836352:12345-0@lo:400:kworker.0 Request processed in 52us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023579.148524:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789023579.148537:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789023579.148542:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024836608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.148572:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024836608:12345-0@lo:400:kworker.0 Request processed in 29us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023579.148578:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789023579.148592:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789023579.148597:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789023579.148600:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023579.148643:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024836480:0@lo:400:kworker.0 00010000:00080000:3.0:1789023579.148680:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1180 x1875927024836352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023579.148692:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024836352:0@lo:400:kworker.0 00000100:00100000:3.0:1789023579.148705:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024835968:0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.149712:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024836096:0@lo:400:kworker.0 00010000:00080000:2.0:1789023579.149731:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65de0ddf80 x1875927024836608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023579.149754:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024836608:0@lo:400:kworker.0 00000100:00100000:2.0:1789023579.149767:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024836224:0@lo:400:kworker.0 00010000:00010000:1.0:1789023579.402381:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023579.658527:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023579.658601:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023579.658822:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836736 00000100:00100000:1.0:1789023579.658831:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836736 00000100:00100000:1.0:1789023579.658880:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789023579.658890:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024836736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023579.658929:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023579.658979:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024836736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023579.658987:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1789023579.659141:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdd880 x1875927024836736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023595 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023579.659159:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024836736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023580.426023:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023581.450045:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023582.226684:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023582.226707:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024836864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023582.227258:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023582.228274:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836864 00000100:00100000:3.0:1789023582.228285:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836864 00000100:00100000:3.0:1789023582.228361:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789023582.228371:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024836864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023582.228408:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023582.228472:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024836864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023582.228502:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1789023582.230190:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdf100 x1875927024836864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023598 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023582.230216:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024836864:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789023582.230790:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789023582.476543:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023582.702366:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023582.702444:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023582.702647:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978560 00000100:00100000:0.0:1789023582.702662:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978560 00000100:00100000:0.0:1789023582.702712:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:0.0:1789023582.702722:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2361:x1875927006978560:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023582.702788:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2361:x1875927006978560:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 67us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023582.702796:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:2.0:1789023582.703345:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978688 00000100:00100000:2.0:1789023582.703351:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978688 00000100:00100000:2.0:1789023582.703446:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:2.0:1789023582.703462:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927006978688:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023582.703541:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927006978688:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 80us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023582.703548:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00080000:0.0:1789023582.704374:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789023583.500582:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023584.266577:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024837120:0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.266641:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023584.266692:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024837632:0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.266717:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023584.266746:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023584.266752:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024837248:0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.266773:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023584.266819:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024837120 00000100:00100000:0.0:1789023584.266826:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024837120 00000100:00100000:0.0:1789023584.266879:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024837248 00000100:00100000:0.0:1789023584.266883:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024837248 00000100:00100000:0.0:1789023584.266913:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789023584.266921:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024837120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.266969:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7250a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024837120:12345-0@lo:400:kworker.0 Request processed in 49us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023584.266976:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789023584.266991:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789023584.266997:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024837248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.267018:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7250380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024837248:12345-0@lo:400:kworker.0 Request processed in 22us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023584.267029:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789023584.267045:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024837632 00000100:00100000:0.0:1789023584.267048:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024837632 00000100:00100000:0.0:1789023584.267071:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023584.267076:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024837632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.267101:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024837632:12345-0@lo:400:kworker.0 Request processed in 25us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023584.267107:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789023584.267124:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023584.267127:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023584.267154:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024837248:0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.267162:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024837120:0@lo:400:kworker.0 00010000:00080000:0.0:1789023584.267173:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7250000 x1875927024837632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023584.267197:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024837632:0@lo:400:kworker.0 00000100:00100000:3.0:1789023584.267589:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024837376:0@lo:400:kworker.0 00000100:00100000:3.0:1789023584.267621:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023584.267650:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789023584.267656:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024836992:0@lo:400:kworker.0 00000100:00100000:3.0:1789023584.267679:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023584.267712:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024837504:0@lo:400:kworker.0 00000100:00100000:3.0:1789023584.267735:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023584.267760:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024836992 00000100:00100000:3.0:1789023584.267764:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024836992 00000100:00100000:3.0:1789023584.267801:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789023584.267808:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024836992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023584.267843:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024836992:12345-0@lo:400:kworker.0 Request processed in 36us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023584.267850:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789023584.267892:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024836992:0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.269020:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024837376 00000100:00100000:0.0:1789023584.269030:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024837376 00000100:00100000:0.0:1789023584.269084:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023584.269092:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024837376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.270008:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024837376:12345-0@lo:400:kworker.0 Request processed in 77us (1547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023584.270020:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789023584.270155:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d0071f80 x1875927024837376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023584.270167:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0071f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024837376:0@lo:400:kworker.0 00000100:00080000:3.0:1789023584.270511:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023584.270592:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024837504 00000100:00100000:0.0:1789023584.270597:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024837504 00000100:00100000:0.0:1789023584.273205:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789023584.273220:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024837504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023584.273321:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024837504:12345-0@lo:400:kworker.0 Request processed in 105us (5584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023584.273327:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789023584.273375:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d0070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024837504:0@lo:400:kworker.0 00000100:00080000:3.0:1789023584.273542:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789023584.527398:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023584.777975:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023584.777996:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024837760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023584.778065:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023584.778293:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024837760 00000100:00100000:3.0:1789023584.778310:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024837760 00000100:00100000:3.0:1789023584.778361:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023584.778369:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024837760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023584.778406:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023584.778456:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024837760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023584.778462:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789023584.778667:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdea00 x1875927024837760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023584.778685:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024837760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023585.546264:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023586.569791:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023587.338025:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023587.338051:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024837888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023587.338122:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023587.338408:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024837888 00000100:00100000:1.0:1789023587.338416:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024837888 00000100:00100000:1.0:1789023587.338493:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023587.338503:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024837888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023587.338653:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023587.338699:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024837888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 197us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023587.338706:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789023587.338726:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789023587.338755:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdd180 x1875927024837888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023603 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023587.338775:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024837888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789023587.600711:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023587.825990:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023587.826172:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978816 00000100:00100000:3.0:1789023587.826183:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978816 00000100:00100000:3.0:1789023587.826317:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:3.0:1789023587.826336:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2361:x1875927006978816:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023587.826412:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2361:x1875927006978816:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 78us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023587.826419:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:3.0:1789023587.826623:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023587.826649:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006978944 00000100:00100000:3.0:1789023587.826654:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006978944 00000100:00100000:3.0:1789023587.826694:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1789023587.826702:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927006978944:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023587.826771:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927006978944:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 70us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023587.826779:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00080000:1.0:1789023587.829068:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789023588.617669:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023589.385811:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024838272:0@lo:400:kworker.0 00000100:00100000:0.0:1789023589.385861:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024838400:0@lo:400:kworker.0 00000100:00100000:0.0:1789023589.385908:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023589.385917:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023589.385979:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789023589.385986:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024838016:0@lo:400:kworker.0 00000100:00100000:3.0:1789023589.386000:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024838144:0@lo:400:kworker.0 00000100:00100000:0.0:1789023589.386015:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023589.386039:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023589.386043:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024838528:0@lo:400:kworker.0 00000100:00100000:3.0:1789023589.386071:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024838656:0@lo:400:kworker.0 00000100:00100000:0.0:1789023589.386073:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023589.386104:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023589.386126:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838400 00000100:00100000:0.0:1789023589.386134:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838400 00000100:00100000:3.0:1789023589.386145:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838272 00000100:00100000:3.0:1789023589.386151:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838272 00000100:00100000:3.0:1789023589.386190:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838144 00000100:00100000:3.0:1789023589.386193:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838144 00000100:00100000:3.0:1789023589.386203:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838528 00000100:00100000:3.0:1789023589.386206:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838528 00000100:00100000:3.0:1789023589.386220:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789023589.386227:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024838272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023589.386283:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024838272:12345-0@lo:400:kworker.0 Request processed in 55us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023589.386312:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789023589.386329:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789023589.386335:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024838144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023589.386378:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024838144:12345-0@lo:400:kworker.0 Request processed in 43us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023589.386385:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789023589.386397:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789023589.386403:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024838528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023589.386448:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024838528:12345-0@lo:400:kworker.0 Request processed in 46us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023589.386454:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789023589.386511:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838656 00000100:00100000:3.0:1789023589.386516:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838656 00000100:00100000:0.0:1789023589.386536:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789023589.386546:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024838400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023589.386581:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024838400:12345-0@lo:400:kworker.0 Request processed in 38us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023589.386653:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024838272:0@lo:400:kworker.0 00000100:00100000:2.0:1789023589.386920:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024838144:0@lo:400:kworker.0 00000100:00100000:2.0:1789023589.386950:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024838528:0@lo:400:kworker.0 00010000:00080000:2.0:1789023589.386962:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65de0de300 x1875927024838400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023589.386972:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024838400:0@lo:400:kworker.0 00000100:00100000:2.0:1789023589.387153:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838016 00000100:00100000:2.0:1789023589.387158:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838016 00000100:00100000:2.0:1789023589.387185:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789023589.387191:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024838016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023589.387229:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024838016:12345-0@lo:400:kworker.0 Request processed in 38us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023589.387235:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789023589.387284:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024838016:0@lo:400:kworker.0 00000100:00080000:2.0:1789023589.387317:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023589.387321:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023589.387331:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023589.391059:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789023589.391080:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024838656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023589.391169:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024838656:12345-0@lo:400:kworker.0 Request processed in 99us (5064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023589.391176:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789023589.391242:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76f9500 x1875927024838656/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023589.391256:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024838656:0@lo:400:kworker.0 00000100:00100000:0.0:1789023589.403510:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789023589.642208:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023589.908297:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023589.908320:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024838784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023589.908390:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023589.908539:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838784 00000100:00100000:1.0:1789023589.908547:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838784 00000100:00100000:1.0:1789023589.908605:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789023589.908615:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024838784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023589.908650:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023589.908706:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024838784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023589.908712:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789023589.909021:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdd180 x1875927024838784/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023605 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023589.909038:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024838784:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789023590.665685:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023591.525290:0:10135:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:59:49 (1789023589) === 00010000:00010000:0.0:1789023591.693190:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023592.162855:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.163130:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979072 00000100:00100000:3.0:1789023592.163141:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979072 00000100:00100000:3.0:1789023592.163206:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:3.0:1789023592.163216:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:8159:x1875927006979072:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789023592.163259:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023592.163277:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713c000/0xc3c1fcbfb3417cc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf858 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023592.163310:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713c000/0xc3c1fcbfb3417cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf858 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023592.163320:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713c000/0xc3c1fcbfb3417cc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf858 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023592.163327:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c000, rc 0) 00000100:00100000:3.0:1789023592.163578:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8159:x1875927006979072:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 363us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.163586:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:0.0:1789023592.176593:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.177513:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979200 00000100:00100000:3.0:1789023592.177525:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979200 00000100:00100000:3.0:1789023592.177588:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:3.0:1789023592.177599:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8159:x1875927006979200:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789023592.178222:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8159:x1875927006979200:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 623us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.178231:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:0.0:1789023592.190719:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023592.190972:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979328 00000100:00100000:2.0:1789023592.190991:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979328 00000100:00100000:2.0:1789023592.191056:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 207 00000100:00100000:2.0:1789023592.191067:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8159:x1875927006979328:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789023592.192151:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8159:x1875927006979328:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 1078us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023592.192163:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 207 00000100:00100000:1.0:1789023592.197091:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.197236:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979456 00000100:00100000:3.0:1789023592.197256:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979456 00000100:00100000:3.0:1789023592.197314:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:3.0:1789023592.197325:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8163:x1875927006979456:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789023592.197658:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8163:x1875927006979456:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 334us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.197673:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:0.0:1789023592.234649:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.234748:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979584 00000100:00100000:3.0:1789023592.234759:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979584 00000100:00100000:3.0:1789023592.234827:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:3.0:1789023592.234837:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8163:x1875927006979584:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789023592.235304:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8163:x1875927006979584:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 283us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.235314:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:0.0:1789023592.245625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023592.245766:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979712 00000100:00100000:1.0:1789023592.245777:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979712 00000100:00100000:1.0:1789023592.245841:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:1.0:1789023592.245852:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:8159:x1875927006979712:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789023592.245869:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023592.245888:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e707e400/0xc3c1fcbfb3417cc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf882 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023592.245915:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707e400/0xc3c1fcbfb3417cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf882 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023592.245926:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e707e400/0xc3c1fcbfb3417cc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf882 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023592.245935:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e400, rc 0) 00000100:00100000:1.0:1789023592.245994:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:8159:x1875927006979712:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 144us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023592.246001:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:1.0:1789023592.252631:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023592.252739:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979840 00000100:00100000:2.0:1789023592.252756:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979840 00000100:00100000:2.0:1789023592.252806:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:2.0:1789023592.252822:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:8159:x1875927006979840:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789023592.252854:0:5839:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789023592.252871:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789023592.252875:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789023592.252878:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789023592.252880:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789023592.262667:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:8159:x1875927006979840:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 9833us (10042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023592.262685:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:0.0:1789023592.274157:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.274635:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006979968 00000100:00100000:3.0:1789023592.274648:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006979968 00000100:00100000:3.0:1789023592.274709:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:3.0:1789023592.274720:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:8159:x1875927006979968:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789023592.274736:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023592.274755:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf889 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023592.274783:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023592.274794:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023592.274803:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713ce00, rc 0) 00000100:00100000:3.0:1789023592.275133:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8159:x1875927006979968:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 414us (986us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.275140:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:1.0:1789023592.278055:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.278392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980096 00000100:00100000:3.0:1789023592.278402:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980096 00000100:00100000:3.0:1789023592.278464:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:3.0:1789023592.278474:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8159:x1875927006980096:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789023592.278801:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8159:x1875927006980096:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 328us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.278819:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:1.0:1789023592.282704:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.283390:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980224 00000100:00100000:3.0:1789023592.283402:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980224 00000100:00100000:3.0:1789023592.283597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:3.0:1789023592.283609:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8159:x1875927006980224:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789023592.284341:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8159:x1875927006980224:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 733us (1905us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.284350:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:1.0:1789023592.289382:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.289691:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980352 00000100:00100000:3.0:1789023592.289701:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980352 00000100:00100000:3.0:1789023592.289992:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:3.0:1789023592.290003:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8165:x1875927006980352:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789023592.290309:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8165:x1875927006980352:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 307us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.290318:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:1.0:1789023592.301089:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.301337:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980480 00000100:00100000:3.0:1789023592.301347:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980480 00000100:00100000:3.0:1789023592.301403:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:3.0:1789023592.301414:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8165:x1875927006980480:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789023592.303125:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:8165:x1875927006980480:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 1696us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.303137:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:1.0:1789023592.313196:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023592.313237:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023592.317104:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980992 00000100:00100000:2.0:1789023592.317407:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980992 00000100:00100000:2.0:1789023592.317523:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980608 00000100:00100000:2.0:1789023592.317527:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980608 00000100:00100000:2.0:1789023592.317554:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789023592.317565:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006980992:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023592.317665:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006980992:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 102us (4479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023592.317690:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789023592.317708:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023592.317713:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2360:x1875927006980608:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789023592.317735:0:5846:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from ae515dcf-9b63-4da3-9356-8fdb8dd01002@192.168.203.48@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:2.0:1789023592.318047:0:5846:0:(genops.c:1384:class_connect()) connect: client ae515dcf-9b63-4da3-9356-8fdb8dd01002, cookie 0xc3c1fcbfb3417cd5 00000004:00100000:2.0:1789023592.318076:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789023592.318406:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8e65f6c56000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023592.318441:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:2360:x1875927006980608:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 726us (5203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023592.318449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00080000:1.0:1789023592.318706:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023592.323041:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023592.323136:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.323272:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980736 00000100:00100000:3.0:1789023592.323281:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980736 00000100:00100000:3.0:1789023592.323349:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006980864 00000100:00100000:3.0:1789023592.323352:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006980864 00000100:00100000:3.0:1789023592.323374:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789023592.323383:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+7:0:x1875927006980736:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789023592.323425:0:7654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789023592.323539:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+7:0:x1875927006980736:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 157us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.323547:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:3.0:1789023592.323566:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789023592.323573:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:8159:x1875927006980864:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789023592.323584:0:7654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789023592.323605:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:8159:x1875927006980864:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.323611:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00080000:1.0:1789023592.324324:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023592.326466:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023592.326738:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006981120 00000100:00100000:2.0:1789023592.326756:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006981120 00000100:00100000:2.0:1789023592.326818:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1789023592.326828:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:8159:x1875927006981120:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789023592.326922:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:8159:x1875927006981120:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 95us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023592.326929:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789023592.331048:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023592.331096:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023592.331191:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006981504 00000100:00100000:3.0:1789023592.331202:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006981504 00000100:00100000:3.0:1789023592.331270:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1789023592.331281:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:8159:x1875927006981504:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789023592.331368:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789023592.331456:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:8159:x1875927006981504:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 176us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023592.331518:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1789023592.334898:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023592.349764:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006981248 00000100:00100000:0.0:1789023592.349780:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006981248 00000100:00100000:0.0:1789023592.349834:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006981376 00000100:00100000:0.0:1789023592.349838:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006981376 00000100:00100000:0.0:1789023592.349880:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1789023592.349888:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875927006981248:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789023592.349920:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from ae515dcf-9b63-4da3-9356-8fdb8dd01002@192.168.203.48@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:0.0:1789023592.349948:0:6696:0:(genops.c:1384:class_connect()) connect: client ae515dcf-9b63-4da3-9356-8fdb8dd01002, cookie 0xc3c1fcbfb3417cdc 00002000:00100000:0.0:1789023592.349959:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ae515dcf-9b63-4da3-9356-8fdb8dd01002/ffff8e65fcba2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789023592.349986:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789023592.350325:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789023592.350355:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023592.350425:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:2360:x1875927006981248:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 537us (19328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023592.350433:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1789023592.350461:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1789023592.350466:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875927006981376:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789023592.350678:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from ae515dcf-9b63-4da3-9356-8fdb8dd01002@192.168.203.48@tcp t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:0.0:1789023592.350695:0:6696:0:(genops.c:1384:class_connect()) connect: client ae515dcf-9b63-4da3-9356-8fdb8dd01002, cookie 0xc3c1fcbfb3417ce3 00002000:00100000:0.0:1789023592.350701:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ae515dcf-9b63-4da3-9356-8fdb8dd01002/ffff8e65fcba5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789023592.350716:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789023592.350904:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789023592.350920:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023592.350946:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:2360:x1875927006981376:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 478us (16057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023592.350952:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1789023592.457819:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024838912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023592.457905:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023592.458291:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024838912 00000100:00100000:1.0:1789023592.458301:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024838912 00000100:00100000:1.0:1789023592.458374:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789023592.458383:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024838912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023592.458408:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023592.458458:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024838912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023592.458465:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789023592.459190:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023592.460785:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdd880 x1875927024838912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023608 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023592.460813:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024838912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789023592.718350:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023593.737584:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023594.505685:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023594.505823:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024839168:0@lo:400:kworker.0 00000100:00100000:1.0:1789023594.505882:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023594.505935:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023594.505942:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024839296:0@lo:400:kworker.0 00000100:00100000:1.0:1789023594.505964:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023594.506514:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024839424:0@lo:400:kworker.0 00000100:00100000:0.0:1789023594.506552:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023594.506585:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024839040:0@lo:400:kworker.0 00000100:00100000:0.0:1789023594.506614:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023594.506653:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839040 00000100:00100000:0.0:1789023594.506659:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839040 00000100:00100000:0.0:1789023594.506699:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789023594.506708:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024839040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023594.506757:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024839040:12345-0@lo:400:kworker.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023594.506814:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839424 00000100:00100000:1.0:1789023594.506818:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839424 00000100:00100000:1.0:1789023594.506857:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789023594.506864:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024839424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023594.506904:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024839424:12345-0@lo:400:kworker.0 Request processed in 40us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023594.506911:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789023594.507071:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024839552:0@lo:400:kworker.0 00000100:00100000:2.0:1789023594.507078:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023594.507093:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024839680:0@lo:400:kworker.0 00000100:00100000:1.0:1789023594.507114:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023594.507131:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023594.507310:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789023594.507353:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839168 00000100:00100000:0.0:1789023594.507358:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839168 00000100:00100000:2.0:1789023594.507367:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839296 00000100:00100000:2.0:1789023594.507374:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839296 00000100:00100000:2.0:1789023594.507401:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839552 00000100:00100000:2.0:1789023594.507404:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839552 00000100:00100000:2.0:1789023594.507418:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789023594.507424:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023594.507458:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024839168:12345-0@lo:400:kworker.0 Request processed in 34us (1576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023594.507465:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789023594.507496:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789023594.507503:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024839296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023594.507533:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024839296:12345-0@lo:400:kworker.0 Request processed in 32us (1569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023594.507538:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789023594.507549:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789023594.507555:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024839552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023594.507670:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024839552:12345-0@lo:400:kworker.0 Request processed in 114us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023594.507677:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1789023594.507698:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023594.507701:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023594.507709:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839680 00000100:00100000:2.0:1789023594.507712:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839680 00000100:00100000:2.0:1789023594.507740:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789023594.507757:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024839680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023594.507828:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024839552:0@lo:400:kworker.0 00000100:00100000:2.0:1789023594.507963:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024839680:12345-0@lo:400:kworker.0 Request processed in 217us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023594.507980:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789023594.508003:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789023594.508004:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76fa680 x1875927024839424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023594.508017:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024839424:0@lo:400:kworker.0 00000100:00100000:2.0:1789023594.508031:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024839296:0@lo:400:kworker.0 00000100:00100000:0.0:1789023594.508033:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024839040:0@lo:400:kworker.0 00000100:00100000:2.0:1789023594.508055:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024839168:0@lo:400:kworker.0 00010000:00080000:1.0:1789023594.514612:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76fa300 x1875927024839680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023594.514632:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024839680:0@lo:400:kworker.0 00010000:00010000:2.0:1789023594.761634:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023595.017889:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023595.017913:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024839808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023595.017981:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023595.018103:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839808 00000100:00100000:0.0:1789023595.018111:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839808 00000100:00100000:0.0:1789023595.018162:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023595.018173:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024839808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023595.018206:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023595.018288:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024839808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023595.018295:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789023595.018539:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e64c2245c00 x1875927024839808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023611 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023595.018559:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024839808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789023595.788940:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789023596.113468:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae515dcf-9b63-4da3-9356-8fdb8dd01002 00010000:00010000:1.0:1789023596.809909:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789023597.142646:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000001:00100000:3.0:1789023597.183549:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000100:00100000:1.0:1789023597.562151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023597.562195:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006981632 00000100:00100000:1.0:1789023597.562205:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006981632 00000100:00100000:1.0:1789023597.562277:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:1.0:1789023597.562288:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927006981632:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023597.562353:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927006981632:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023597.562361:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:0.0:1789023597.568146:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023597.568188:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023597.568228:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023597.568266:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023597.568295:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982016 00000100:00100000:0.0:1789023597.568304:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982016 00000100:00100000:0.0:1789023597.568356:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982144 00000100:00100000:0.0:1789023597.568359:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982144 00000100:00100000:0.0:1789023597.568381:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789023597.568390:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006982016:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023597.568666:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006982016:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 275us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023597.568685:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789023597.568702:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:0.0:1789023597.568708:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982144:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023597.568745:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982144:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023597.568751:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00080000:0.0:1789023597.568772:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023597.568776:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023597.569079:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006981760 00000100:00100000:2.0:1789023597.569085:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006981760 00000100:00100000:2.0:1789023597.569127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006981888 00000100:00100000:2.0:1789023597.569130:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006981888 00000100:00100000:2.0:1789023597.569154:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789023597.569161:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006981760:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023597.569198:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006981760:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023597.569205:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789023597.569232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:2.0:1789023597.569239:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006981888:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023597.569277:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006981888:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 39us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023597.569282:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00080000:0.0:1789023597.569737:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023597.578669:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024839936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789023597.578744:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023597.578962:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024839936 00000100:00100000:1.0:1789023597.578970:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024839936 00000100:00100000:1.0:1789023597.579029:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789023597.579038:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024839936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023597.579073:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023597.579117:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024839936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023597.579124:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1789023597.579225:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023597.579264:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e64c2245c00 x1875927024839936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023613 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023597.579281:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024839936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789023597.842881:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023597.936883:0:10331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1789023598.857703:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023599.628285:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024840064:0@lo:400:kworker.0 00000100:00100000:3.0:1789023599.628287:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024840448:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.628629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023599.628681:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024840576:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.629175:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023599.629239:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840064 00000100:00100000:1.0:1789023599.629247:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840064 00000100:00100000:1.0:1789023599.630134:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789023599.630147:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024840064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.630227:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024840064:12345-0@lo:400:kworker.0 Request processed in 84us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023599.630234:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789023599.630831:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024840064:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.631577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840576 00000100:00100000:1.0:1789023599.631586:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840576 00000100:00100000:1.0:1789023599.631653:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789023599.631661:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024840576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.631851:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024840576:12345-0@lo:400:kworker.0 Request processed in 189us (3136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023599.631867:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789023599.631899:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024840320:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.631936:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023599.631967:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789023599.631974:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024840192:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.631993:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023599.632007:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024840704:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.632025:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789023599.632045:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023599.632055:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840320 00000100:00100000:1.0:1789023599.632058:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840320 00000100:00100000:1.0:1789023599.632079:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840192 00000100:00100000:1.0:1789023599.632081:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840192 00000100:00100000:1.0:1789023599.632092:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789023599.632098:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024840320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.632126:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024840320:12345-0@lo:400:kworker.0 Request processed in 29us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023599.632132:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789023599.632143:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789023599.632147:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024840192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.632170:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024840192:12345-0@lo:400:kworker.0 Request processed in 23us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023599.632175:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789023599.632192:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840704 00000100:00100000:1.0:1789023599.632195:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840704 00000100:00100000:1.0:1789023599.632230:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789023599.632241:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024840704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.632268:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024840704:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023599.633880:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1789023599.633929:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023599.633933:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023599.633972:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024840192:0@lo:400:kworker.0 00010000:00080000:1.0:1789023599.633987:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76ff480 x1875927024840704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023599.633997:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024840704:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.634008:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024840320:0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.634049:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024840576:0@lo:400:kworker.0 00000100:00100000:3.0:1789023599.635248:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023599.635368:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840448 00000100:00100000:1.0:1789023599.635377:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840448 00000100:00100000:1.0:1789023599.635441:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789023599.635450:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024840448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023599.635543:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024840448:12345-0@lo:400:kworker.0 Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023599.635551:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789023599.635853:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789023599.635881:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c1180 x1875927024840448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023599.635895:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024840448:0@lo:400:kworker.0 00010000:00010000:0.0:1789023599.887053:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023600.139046:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023600.139069:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024840832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023600.139133:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023600.139253:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840832 00000100:00100000:0.0:1789023600.139262:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840832 00000100:00100000:0.0:1789023600.139319:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789023600.139330:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024840832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023600.139366:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023600.139414:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024840832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023600.139421:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789023600.139464:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7250e00 x1875927024840832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023616 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023600.139509:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7250e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024840832:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023600.906269:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023601.929716:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023602.670550:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023602.670588:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982400 00000100:00100000:1.0:1789023602.670597:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982400 00000100:00100000:1.0:1789023602.670665:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:0.0:1789023602.670665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023602.670679:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006982400:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023602.670699:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023602.670723:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023602.671148:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7250e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006982400:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 472us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023602.671573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:1.0:1789023602.671596:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982528 00000100:00100000:1.0:1789023602.671601:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982528 00000100:00100000:1.0:1789023602.671634:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1789023602.671641:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982528:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023602.678774:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982272 00000100:00100000:3.0:1789023602.678789:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982272 00000100:00100000:3.0:1789023602.678843:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:3.0:1789023602.678853:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927006982272:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023602.678926:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927006982272:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 74us (8227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023602.678934:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:3.0:1789023602.678967:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982656 00000100:00100000:3.0:1789023602.678971:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982656 00000100:00100000:3.0:1789023602.679004:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1789023602.679011:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982656:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023602.679189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023602.680732:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982656:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 1712us (10063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023602.680754:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1789023602.680782:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982784 00000100:00100000:3.0:1789023602.680789:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982784 00000100:00100000:3.0:1789023602.680829:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1789023602.680837:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982784:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023602.680869:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982784:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 33us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023602.680876:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00080000:3.0:1789023602.680903:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789023602.680907:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789023602.680910:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023602.688576:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7250700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006982528:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 16922us (17839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023602.688590:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1789023602.697694:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023602.697718:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024840960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023602.698232:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023602.698967:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024840960 00000100:00100000:0.0:1789023602.698977:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024840960 00000100:00100000:0.0:1789023602.699096:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789023602.699108:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024840960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023602.699147:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023602.699237:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024840960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023602.699244:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789023602.699297:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7251c00 x1875927024840960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023618 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023602.699318:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024840960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789023602.704330:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789023602.954471:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023603.981471:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023604.747357:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024841216:0@lo:400:kworker.0 00000100:00100000:1.0:1789023604.747421:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023604.747468:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024841728:0@lo:400:kworker.0 00000100:00100000:1.0:1789023604.747523:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023604.747554:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023604.747560:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024841344:0@lo:400:kworker.0 00000100:00100000:1.0:1789023604.747582:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023604.747619:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841216 00000100:00100000:1.0:1789023604.747626:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841216 00000100:00100000:1.0:1789023604.747668:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841344 00000100:00100000:1.0:1789023604.747671:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841344 00000100:00100000:1.0:1789023604.747700:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789023604.747708:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024841216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023604.747770:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024841216:12345-0@lo:400:kworker.0 Request processed in 63us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023604.747777:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789023604.747803:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789023604.747809:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024841344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023604.747838:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024841344:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023604.747844:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789023604.747861:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841728 00000100:00100000:1.0:1789023604.747865:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841728 00000100:00100000:1.0:1789023604.747892:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789023604.747898:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024841728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023604.747925:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f698ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024841728:12345-0@lo:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023604.747930:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789023604.748213:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024841472:0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748245:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023604.748272:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789023604.748278:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024841088:0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748302:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023604.748323:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024841600:0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748342:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023604.748364:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841472 00000100:00100000:0.0:1789023604.748368:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841472 00000100:00100000:0.0:1789023604.748403:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789023604.748409:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024841472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748443:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024841472:12345-0@lo:400:kworker.0 Request processed in 34us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023604.748449:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789023604.748500:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c84c0380 x1875927024841472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023604.748513:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024841472:0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748551:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841600 00000100:00100000:0.0:1789023604.748554:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841600 00000100:00100000:0.0:1789023604.748575:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789023604.748582:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024841600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748616:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7253480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024841600:12345-0@lo:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023604.748621:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789023604.748635:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789023604.748639:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023604.748642:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023604.748663:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024841600:0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748697:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024841344:0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748706:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024841216:0@lo:400:kworker.0 00010000:00080000:0.0:1789023604.748715:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c95f80 x1875927024841728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023620 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023604.748737:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024841728:0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748773:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841088 00000100:00100000:0.0:1789023604.748777:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841088 00000100:00100000:0.0:1789023604.748798:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789023604.748803:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024841088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023604.748835:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024841088:12345-0@lo:400:kworker.0 Request processed in 32us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023604.748840:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789023604.748867:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024841088:0@lo:400:kworker.0 00010000:00010000:0.0:1789023605.001667:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023605.258648:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023605.258674:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024841856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023605.258750:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023605.258849:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841856 00000100:00100000:3.0:1789023605.258857:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841856 00000100:00100000:3.0:1789023605.258907:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789023605.258917:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024841856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023605.258953:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023605.259003:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024841856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023605.259010:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789023605.259218:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7250000 x1875927024841856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023621 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023605.259240:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7250000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024841856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023606.025894:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023607.050191:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023607.802455:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023607.805301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006982912 00000100:00100000:1.0:1789023607.805317:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006982912 00000100:00100000:1.0:1789023607.805383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:1.0:1789023607.805394:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006982912:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023607.805672:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006982912:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 278us (3222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023607.805680:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:3.0:1789023607.816711:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023607.816754:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023607.816784:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023607.816803:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983296 00000100:00100000:2.0:1789023607.816813:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983296 00000100:00100000:3.0:1789023607.816821:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023607.816875:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983424 00000100:00100000:2.0:1789023607.816879:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983424 00000100:00100000:1.0:1789023607.816879:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983040 00000100:00100000:1.0:1789023607.816883:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983040 00000100:00100000:2.0:1789023607.816906:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1789023607.816908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983168 00000100:00100000:1.0:1789023607.816910:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983168 00000100:00100000:2.0:1789023607.816915:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006983296:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023607.816928:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:1.0:1789023607.816933:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006983040:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023607.816989:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006983296:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023607.816992:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1789023607.816996:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:3.0:1789023607.817000:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006983424:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023607.817234:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006983040:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 300us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023607.817247:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:1.0:1789023607.817261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:1.0:1789023607.817267:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006983168:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023607.817295:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006983168:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023607.817300:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:3.0:1789023607.817579:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006983424:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 578us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023607.817587:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1789023607.818927:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023607.818958:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024841984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023607.819015:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023607.819142:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024841984 00000100:00100000:2.0:1789023607.819159:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024841984 00000100:00100000:2.0:1789023607.819211:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789023607.819220:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024841984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023607.819251:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023607.819296:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024841984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023607.819313:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789023607.819717:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76fb800 x1875927024841984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023607.819737:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024841984:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789023607.819796:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789023607.819802:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023607.819804:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789023608.075860:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023609.099448:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023609.866699:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024842112:0@lo:400:kworker.0 00000100:00100000:2.0:1789023609.866779:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023609.867003:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024842112 00000100:00100000:0.0:1789023609.867012:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024842112 00000100:00100000:0.0:1789023609.867065:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789023609.867075:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024842112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023609.867166:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024842112:12345-0@lo:400:kworker.0 Request processed in 93us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023609.867174:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789023609.867214:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024842240:0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.867229:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024842496:0@lo:400:kworker.0 00000100:00100000:0.0:1789023609.867245:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023609.867276:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024842752:0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.867283:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023609.867318:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024842240 00000100:00100000:0.0:1789023609.867328:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024842240 00000100:00100000:1.0:1789023609.867330:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023609.867350:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024842624:0@lo:400:kworker.0 00000100:00100000:0.0:1789023609.867367:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789023609.867376:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024842240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.867383:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023609.867429:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024842368:0@lo:400:kworker.0 00000100:00100000:0.0:1789023609.867434:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7250000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024842240:12345-0@lo:400:kworker.0 Request processed in 57us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023609.867442:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789023609.867457:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024842624 00000100:00100000:0.0:1789023609.867461:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024842624 00000100:00100000:1.0:1789023609.867464:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023609.867522:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024842368 00000100:00100000:0.0:1789023609.867527:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024842368 00000100:00100000:1.0:1789023609.867537:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789023609.867547:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024842624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.867587:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024842624:12345-0@lo:400:kworker.0 Request processed in 43us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023609.867595:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789023609.867612:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789023609.867619:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024842368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.868372:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024842368:12345-0@lo:400:kworker.0 Request processed in 754us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023609.868381:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789023609.868499:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024842368:0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.868534:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024842624:0@lo:400:kworker.0 00000100:00080000:0.0:1789023609.868657:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023609.868671:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023609.868721:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024842240:0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.869249:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024842496 00000100:00100000:1.0:1789023609.869256:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024842496 00000100:00100000:1.0:1789023609.869319:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024842752 00000100:00100000:1.0:1789023609.869322:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024842752 00000100:00100000:1.0:1789023609.869357:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789023609.869365:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024842496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.869425:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024842496:12345-0@lo:400:kworker.0 Request processed in 60us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023609.869431:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789023609.869445:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789023609.869452:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024842752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023609.869506:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024842752:12345-0@lo:400:kworker.0 Request processed in 55us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023609.869514:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789023609.869554:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c96a00 x1875927024842496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023609.869566:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024842496:0@lo:400:kworker.0 00000100:00080000:0.0:1789023609.870356:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023609.870362:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789023609.870390:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c95180 x1875927024842752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023625 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023609.870411:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024842752:0@lo:400:kworker.0 00000100:00100000:2.0:1789023609.874379:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024842112:0@lo:400:kworker.0 00010000:00010000:1.0:1789023610.124179:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023610.386328:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023610.386348:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024842880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023610.386412:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023610.386496:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024842880 00000100:00100000:0.0:1789023610.386503:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024842880 00000100:00100000:0.0:1789023610.386544:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789023610.386553:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024842880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023610.386585:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023610.386629:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024842880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023610.386649:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1789023610.386690:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7253800 x1875927024842880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023626 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023610.386709:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024842880:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789023611.146362:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023612.169638:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023612.911781:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023612.911819:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023612.911852:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023612.911868:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023612.911935:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023612.911974:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983936 00000100:00100000:1.0:1789023612.911983:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983936 00000100:00100000:1.0:1789023612.912025:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984064 00000100:00100000:1.0:1789023612.912027:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984064 00000100:00100000:1.0:1789023612.912043:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789023612.912052:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2360:x1875927006983936:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:1.0:1789023612.912079:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417cdc 00000100:00080000:1.0:1789023612.912087:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789023612.912127:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789023612.912408:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+2:2360:x1875927006983936:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 357us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023612.912416:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789023612.912430:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1789023612.912436:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2360:x1875927006984064:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:1.0:1789023612.912447:0:6696:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417ce3 00000100:00080000:1.0:1789023612.912452:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789023612.912469:0:6696:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789023612.912640:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+2:2360:x1875927006984064:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 203us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023612.912646:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00010000:00010000:1.0:1789023612.912668:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023612.912672:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023612.912758:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983680 00000100:00100000:0.0:1789023612.912763:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983680 00000100:00100000:0.0:1789023612.912788:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983808 00000100:00100000:0.0:1789023612.912790:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983808 00000100:00100000:0.0:1789023612.912806:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:0.0:1789023612.912811:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006983680:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023612.912840:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006983680:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023612.912846:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:0.0:1789023612.912856:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:0.0:1789023612.912861:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006983808:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023612.912877:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006983808:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 16us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023612.912882:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00080000:0.0:1789023612.912896:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023612.912899:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023612.912901:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023612.913057:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006983552 00000100:00100000:3.0:1789023612.913061:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006983552 00000100:00100000:3.0:1789023612.913155:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:3.0:1789023612.913162:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006983552:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023612.913186:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006983552:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023612.913192:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:3.0:1789023612.937794:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023612.937818:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024843008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023612.937881:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023612.937980:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843008 00000100:00100000:2.0:1789023612.937987:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843008 00000100:00100000:2.0:1789023612.938053:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789023612.938063:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024843008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023612.938094:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023612.938149:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024843008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023612.938158:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789023612.938209:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789023612.938271:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76f9880 x1875927024843008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023628 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023612.938290:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024843008:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789023613.193812:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023614.086121:0:11032:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789023614.222967:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023614.985998:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024843136:0@lo:400:kworker.0 00000100:00100000:3.0:1789023614.986070:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023614.986255:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843136 00000100:00100000:1.0:1789023614.986264:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843136 00000100:00100000:1.0:1789023614.986338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789023614.986347:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024843136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.986727:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024843520:0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.986763:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023614.986828:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024843392:0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.986866:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023614.986887:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023614.986893:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024843264:0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.986913:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023614.986952:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843392 00000100:00100000:2.0:1789023614.986956:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843392 00000100:00100000:2.0:1789023614.986992:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843264 00000100:00100000:2.0:1789023614.987002:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843264 00000100:00100000:2.0:1789023614.987026:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789023614.987033:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024843392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.987071:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024843392:12345-0@lo:400:kworker.0 Request processed in 38us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023614.987078:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789023614.987094:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789023614.987113:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024843264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.987143:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024843264:12345-0@lo:400:kworker.0 Request processed in 31us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023614.987149:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789023614.987199:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7252a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024843264:0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.987210:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7251180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024843392:0@lo:400:kworker.0 00000100:00080000:2.0:1789023614.987249:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023614.987267:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843520 00000100:00100000:2.0:1789023614.987271:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843520 00000100:00100000:2.0:1789023614.987302:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789023614.987309:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024843520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023614.987363:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024843520:12345-0@lo:400:kworker.0 Request processed in 55us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023614.987370:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789023614.987387:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789023614.987404:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7251c00 x1875927024843520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023614.987414:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024843520:0@lo:400:kworker.0 00000100:00100000:1.0:1789023614.988447:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024843136:12345-0@lo:400:kworker.0 Request processed in 2097us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023614.988457:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789023614.988562:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024843136:0@lo:400:kworker.0 00000100:00100000:3.0:1789023614.989031:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024843648:0@lo:400:kworker.0 00000100:00100000:3.0:1789023614.989075:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023614.989219:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024843776:0@lo:400:kworker.0 00000100:00100000:0.0:1789023614.989263:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023614.989538:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843776 00000100:00100000:1.0:1789023614.989545:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843776 00000100:00100000:1.0:1789023614.989599:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789023614.989606:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024843776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023614.989659:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024843776:12345-0@lo:400:kworker.0 Request processed in 43us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023614.989666:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789023614.989809:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843648 00000100:00100000:2.0:1789023614.989815:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843648 00000100:00100000:2.0:1789023614.989861:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789023614.989868:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024843648:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789023614.989947:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7251c00 x1875927024843776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023630 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023614.989959:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024843776:0@lo:400:kworker.0 00000100:00080000:0.0:1789023614.989980:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023614.989984:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023614.990468:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024843648:12345-0@lo:400:kworker.0 Request processed in 599us (1391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023614.990495:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789023614.990578:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7253800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024843648:0@lo:400:kworker.0 00010000:00010000:0.0:1789023615.242719:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023615.499676:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023615.499699:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024843904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023615.499765:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023615.499824:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024843904 00000100:00100000:0.0:1789023615.499832:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024843904 00000100:00100000:0.0:1789023615.499879:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789023615.499889:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024843904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023615.499926:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023615.500219:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024843904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 330us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023615.500228:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789023615.504290:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e7251c00 x1875927024843904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023631 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023615.504318:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7251c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024843904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789023616.266536:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789023616.601169:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000020:00000080:1.0:1789023616.601182:0:6722:0:(genops.c:885:class_export_put()) final put ffff8e65fcba2800/ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000020:00000080:1.0:1789023616.601218:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65fcba2800/ae515dcf-9b63-4da3-9356-8fdb8dd01002 for lustre-OST0000 00000020:00000080:1.0:1789023616.601275:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65fcba4000 for lustre-OST0000 00010000:00010000:2.0:1789023617.290144:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789023617.620755:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000020:00000080:3.0:1789023617.620850:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e65fcba5800/ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000020:00000080:1.0:1789023617.620977:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65fcba5800/ae515dcf-9b63-4da3-9356-8fdb8dd01002 for lustre-OST0001 00000020:00000080:1.0:1789023617.621037:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65fcba6000 for lustre-OST0001 00000020:00000080:3.0:1789023617.696580:0:11182:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff4caf3860 20000000:00000080:3.0:1789023617.696609:0:11182:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e65f6c04400 uarg=0000000000000000 20000000:01000000:3.0:1789023617.696647:0:11182:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789023617.696652:0:11182:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789023617.696656:0:11182:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789023617.697687:0:11183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789023617.698846:0:11182:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789023617.714850:0:11182:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789023617.715256:0:11182:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715276:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715284:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715291:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715301:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715308:0:11182:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715316:0:11182:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715374:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715390:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 12 pid: 5840 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.715404:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844032:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023617.715951:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.715962:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 12 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.715971:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844160:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023617.716001:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.716009:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 18 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.716017:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844288:0@lo:104: 00000100:00100000:2.0:1789023617.716050:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023617.716133:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.716141:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 18 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.716174:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844416:0@lo:104: 00000100:00100000:2.0:1789023617.716196:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789023617.716322:0:11182:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023617.716331:0:11182:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 18 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.716339:0:11182:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844544:0@lo:104: 00000100:00100000:2.0:1789023617.716360:0:11182:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023617.716374:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024844288 00000100:00100000:1.0:1789023617.716381:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024844288 00000100:00100000:1.0:1789023617.716435:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024844416 00000100:00100000:1.0:1789023617.716439:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024844416 00000100:00100000:3.0:1789023617.716458:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789023617.716472:0:7643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+4:11182:x1875927024844288:12345-0@lo:104: 00000100:00100000:1.0:1789023617.716473:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789023617.716504:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023617.716520:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:11182:x1875927024844416:12345-0@lo:104: 00010000:00010000:1.0:1789023617.716531:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.716573:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789023617.716581:0:7643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+4:11182:x1875927024844288:12345-0@lo:104: Request processed in 114us (530us total) trans 0 rc 0/0 00010000:00010000:1.0:1789023617.716583:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789023617.716589:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023617.716600:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:11182:x1875927024844416:12345-0@lo:104: Request processed in 82us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023617.716608:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789023617.716635:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023617.716636:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023617.716648:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.716649:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.716656:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023617.716662:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.716669:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fd200 already unused, calling callback (ffffffffc1d87c20) 00010000:00010000:1.0:1789023617.716674:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023617.716675:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023617.716693:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.716695:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023617.716710:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:3.0:1789023617.716713:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023617.716722:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789023617.716738:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.716744:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.716746:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023617.716756:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023617.716770:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.716778:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e713cc00/0xc3c1fcbfb3417c9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417ca4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.716790:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023617.716793:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023617.716795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023617.716815:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024844672:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023617.716848:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023617.716883:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023617.716890:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024844800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023617.716913:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023617.716942:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024844672 00000100:00100000:1.0:1789023617.716946:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024844672 00010000:00010000:1.0:1789023617.716963:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 19 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023617.716983:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024844800 00000100:00100000:1.0:1789023617.716986:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024844800 00010000:00010000:1.0:1789023617.716997:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 20 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023617.717014:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789023617.717020:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c8134450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+20:3310:x1875927024844672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023617.717029:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023617.717033:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 20 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.717042:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 20 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.717056:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023617.717096:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c8134450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+20:3310:x1875927024844672:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023617.717103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789023617.717142:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789023617.717148:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024844800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023617.717314:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023617.717319:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 19 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.717327:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 19 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.717336:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023617.717358:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024844800:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023617.717364:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789023617.717406:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024844800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023617.717414:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024844672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023617.717724:0:11182:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc723c0 going to sleep for 11 seconds 00010000:00010000:2.0:1789023617.717740:0:11182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc600/0xc3c1fcbfb3417cb2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cab expref: 18 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.717751:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844288:0@lo:104: 00010000:00010000:2.0:1789023617.717759:0:11182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713c200/0xc3c1fcbfb3417ca4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c9d expref: 17 pid: 5839 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.717766:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844416:0@lo:104: 00000100:00100000:1.0:1789023617.717810:0:7643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024844544 00000100:00100000:1.0:1789023617.717815:0:7643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024844544 00000100:00100000:1.0:1789023617.717876:0:7643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789023617.717883:0:7643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+3:11182:x1875927024844544:12345-0@lo:104: 00010000:00010000:1.0:1789023617.717893:0:7643:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.717932:0:7643:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789023617.717937:0:7643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:72bd38e6-1e7e-4158-85a3-542824dd2807+3:11182:x1875927024844544:12345-0@lo:104: Request processed in 55us (1577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023617.717942:0:7643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789023617.717984:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844544:0@lo:104: 00010000:00010000:1.0:1789023617.718019:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023617.718024:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.718043:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fe00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023617.718047:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.718055:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023617.718062:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023617.718068:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789023617.718133:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.718140:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023617.718158:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023617.718226:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024844928:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023617.718238:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e707fe00/0xc3c1fcbfb3417c8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417c96 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.718250:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023617.718252:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023617.718254:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023617.718265:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023617.718280:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024844928 00000100:00100000:1.0:1789023617.718286:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024844928 00010000:00010000:1.0:1789023617.718304:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 17 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023617.718324:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023617.718336:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:3312:x1875927024844928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023617.718345:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023617.718350:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 17 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.718359:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 17 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.718370:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417c96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417c8f expref: 17 pid: 5840 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023617.718379:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023617.718411:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3312:x1875927024844928:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023617.718418:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789023617.718455:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024844928:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023617.720443:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.720461:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd200/0xc3c1fcbfb3417cab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417cb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.720498:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023617.720500:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023617.720503:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023617.722202:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844032:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023617.722217:0:11182:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11182:1875927024844160:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023617.722248:0:11182:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023617.729230:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023617.729281:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023617.729357:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984320 00000100:00100000:2.0:1789023617.729368:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984320 00010000:00010000:2.0:1789023617.729405:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 13 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023617.729632:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984192 00000100:00100000:2.0:1789023617.729636:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984192 00010000:00010000:2.0:1789023617.729652:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 14 pid: 5840 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023617.729996:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1789023617.730007:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+14:2361:x1875927006984320:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023617.730022:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023617.730028:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 14 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730045:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 14 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730062:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cb9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf851 expref: 14 pid: 5838 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730076:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023617.730149:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7253800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006984320:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 144us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023617.730156:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1789023617.730176:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1789023617.730183:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:2362:x1875927006984192:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023617.730190:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023617.730195:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 12 pid: 5840 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730204:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 12 pid: 5840 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730213:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713ce00/0xc3c1fcbfb3417cce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf889 expref: 12 pid: 5840 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730224:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730231:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730256:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730263:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730269:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730288:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730414:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fc800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023617.730419:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730428:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730445:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023617.730455:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023617.730496:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:2362:x1875927006984192:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 294us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023617.730504:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00010000:00010000:0.0:1789023617.732076:0:11182:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023617.732101:0:11182:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023617.732108:0:11182:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417cea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023618.031752:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023618.031800:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023618.031888:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984576 00000100:00100000:2.0:1789023618.031898:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984576 00000100:00100000:2.0:1789023618.031974:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984448 00000100:00100000:2.0:1789023618.031977:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984448 00000100:00100000:2.0:1789023618.032003:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:2.0:1789023618.032012:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006984576:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023618.032044:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1789023618.032054:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006984448:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:0.0:1789023618.032177:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023618.032224:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0073800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006984576:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 82us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023618.032231:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:1.0:1789023618.035388:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0073480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006984448:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 3324us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023618.035405:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1789023618.058062:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024845056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023618.058140:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023618.066420:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845056 00000100:00100000:0.0:1789023618.066435:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845056 00000100:00100000:0.0:1789023618.066525:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789023618.066536:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024845056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023618.066573:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023618.066668:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024845056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (8527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023618.066675:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1789023618.066806:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789023618.067342:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76fbb80 x1875927024845056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023634 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023618.067365:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024845056:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789023618.315190:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023619.339902:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789023619.401624:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789023619.401632:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65fc5ee000 from 7 10000000:01000000:2.0:1789023619.401637:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789023619.401682:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.401707:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.401719:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023619.401745:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.401808:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.401863:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023619.401921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845184 00000100:00100000:1.0:1789023619.401929:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845184 00000100:00100000:1.0:1789023619.401981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789023619.401989:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024845184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023619.402001:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023619.402013:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417cf1 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023619.402034:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023619.402045:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023619.402054:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e000, rc 0) 00000100:00100000:1.0:1789023619.402105:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024845184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023619.402112:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789023619.402464:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023619.402523:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.402533:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023619.402589:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.402615:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.402639:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023619.402702:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845312 00000100:00100000:1.0:1789023619.402707:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845312 00000100:00100000:1.0:1789023619.402737:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789023619.402743:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024845312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023619.402999:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024845312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023619.403007:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789023619.403462:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.403528:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.403573:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.403608:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023619.403907:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845440 00000100:00100000:1.0:1789023619.403914:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845440 00000100:00100000:1.0:1789023619.403962:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789023619.403969:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024845440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023619.404136:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024845440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023619.404143:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1789023619.404290:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789023619.408936:0:11236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789023619.409132:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789023619.409155:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023619.409167:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.409179:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023619.409189:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789023619.409192:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d089d800 from 7 10000000:01000000:2.0:1789023619.409194:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789023619.409228:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.409247:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.409260:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023619.409284:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.409351:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.409870:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72900 going to sleep for 11 seconds 00000100:00100000:3.0:1789023619.410661:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845568 00000100:00100000:3.0:1789023619.410673:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845568 00000100:00100000:0.0:1789023619.411605:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789023619.411620:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024845568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023619.411637:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023619.411655:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417cff expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023619.411706:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023619.411716:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023619.411724:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05000, rc 0) 00000100:00100000:0.0:1789023619.411800:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024845568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (2449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023619.411807:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789023619.411986:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023619.412003:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.412013:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023619.412100:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.412134:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.412171:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72900 going to sleep for 11 seconds 00000100:00100000:0.0:1789023619.412267:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845696 00000100:00100000:0.0:1789023619.412273:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845696 00000100:00100000:0.0:1789023619.412312:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789023619.412319:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024845696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023619.412766:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024845696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023619.412774:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789023619.412855:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.412888:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.412924:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.412951:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72900 going to sleep for 11 seconds 00000100:00100000:0.0:1789023619.412991:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845824 00000100:00100000:0.0:1789023619.412995:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845824 00000100:00100000:0.0:1789023619.413127:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789023619.413135:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024845824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023619.413277:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024845824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023619.413284:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789023619.413381:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789023619.415393:0:11238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789023619.416815:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789023619.416839:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789023619.416849:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023619.416862:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023619.416872:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789023619.416874:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d252c800 from 7 10000000:01000000:3.0:1789023619.416877:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789023619.416909:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023619.416917:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023619.416928:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023619.416951:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789023619.417011:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023619.429835:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023619.436963:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024845952 00000100:00100000:2.0:1789023619.436977:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024845952 00000100:00100000:2.0:1789023619.437442:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789023619.437454:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024845952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023619.437470:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023619.437505:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417d0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.437534:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.437546:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.437555:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fc800, rc 0) 00000100:00100000:2.0:1789023619.437630:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024845952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (20618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023619.437637:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789023619.441350:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024845952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023619.441377:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.441389:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023619.441468:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.441544:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.441580:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72000 going to sleep for 11 seconds 00000100:00100000:2.0:1789023619.441598:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846080 00000100:00100000:2.0:1789023619.441604:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846080 00000100:00100000:2.0:1789023619.441645:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789023619.441654:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024846080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.441890:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024846080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023619.441898:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789023619.441933:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024846080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.441958:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024846208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.441993:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023619.442006:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72000 going to sleep for 11 seconds 00000100:00100000:2.0:1789023619.442017:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846208 00000100:00100000:2.0:1789023619.442020:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846208 00000100:00100000:2.0:1789023619.442036:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789023619.442041:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024846208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.442190:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024846208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023619.442198:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1789023619.442237:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024846208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789023619.443141:0:11241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789023619.443196:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789023619.443212:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789023619.443220:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.443230:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023619.505429:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023619.505918:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984704 00000100:00100000:2.0:1789023619.505928:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984704 00000100:00100000:2.0:1789023619.505981:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 235 00000100:00100000:2.0:1789023619.505991:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:5602:x1875927006984704:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023619.506007:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023619.506022:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8b3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.506048:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.506059:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.506078:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fc000, rc 0) 00000100:00100000:2.0:1789023619.506130:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006984704:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 141us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023619.506137:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 235 00000100:00100000:0.0:1789023619.512178:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023619.512267:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984832 00000100:00100000:1.0:1789023619.512276:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984832 00000100:00100000:1.0:1789023619.512328:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:1.0:1789023619.512339:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006984832:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023619.512620:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006984832:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 283us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023619.512629:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:1.0:1789023619.514569:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023619.514868:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006984960 00000100:00100000:0.0:1789023619.514886:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006984960 00000100:00100000:0.0:1789023619.514977:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00100000:0.0:1789023619.514988:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006984960:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023619.515197:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006984960:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 211us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023619.515206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00100000:0.0:1789023619.520505:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023619.520665:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985088 00000100:00100000:2.0:1789023619.520675:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985088 00000100:00100000:2.0:1789023619.520853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00100000:2.0:1789023619.520864:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006985088:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023619.520878:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023619.520894:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8ba expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.520932:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.520948:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023619.520957:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65d71fde00, rc 0) 00000100:00100000:2.0:1789023619.521016:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006985088:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 154us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023619.521023:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00100000:2.0:1789023619.524317:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023619.526223:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985216 00000100:00100000:0.0:1789023619.526236:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985216 00000100:00100000:0.0:1789023619.526351:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:0.0:1789023619.526362:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006985216:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023619.526651:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006985216:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 291us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023619.526659:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:0.0:1789023619.530006:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023619.530123:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985344 00000100:00100000:2.0:1789023619.530134:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985344 00000100:00100000:2.0:1789023619.530221:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:2.0:1789023619.530232:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006985344:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023619.530431:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006985344:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 200us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023619.530440:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:2.0:1789023620.107239:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024846336:0@lo:400:kworker.0 00000100:00100000:2.0:1789023620.107313:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023620.108095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846336 00000100:00100000:1.0:1789023620.108104:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846336 00000100:00100000:1.0:1789023620.108392:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789023620.108402:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024846336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.114916:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024846464:0@lo:400:kworker.0 00000100:00100000:1.0:1789023620.115073:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0962c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024846336:12345-0@lo:400:kworker.0 Request processed in 6662us (7749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023620.115086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789023620.116545:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023620.116586:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024846976:0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.116615:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023620.116646:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023620.116740:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024846848:0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.116767:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023620.116805:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024846592:0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.116828:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023620.116848:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023620.116855:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024846720:0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.116878:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023620.116912:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846464 00000100:00100000:3.0:1789023620.116919:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846464 00000100:00100000:3.0:1789023620.117035:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846848 00000100:00100000:3.0:1789023620.117039:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846848 00000100:00100000:3.0:1789023620.117072:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846592 00000100:00100000:3.0:1789023620.117075:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846592 00000100:00100000:3.0:1789023620.117094:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789023620.117102:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024846464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.117155:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024846464:12345-0@lo:400:kworker.0 Request processed in 54us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023620.117163:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789023620.117178:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789023620.117184:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024846848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.117212:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024846848:12345-0@lo:400:kworker.0 Request processed in 29us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023620.117218:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789023620.117806:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789023620.117816:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024846592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.117859:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024846592:12345-0@lo:400:kworker.0 Request processed in 46us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023620.117876:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789023620.117898:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846976 00000100:00100000:3.0:1789023620.117903:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846976 00000100:00100000:3.0:1789023620.118098:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024846720 00000100:00100000:3.0:1789023620.118103:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024846720 00000100:00100000:3.0:1789023620.118128:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789023620.118135:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024846976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.118169:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024846976:12345-0@lo:400:kworker.0 Request processed in 35us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023620.118175:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789023620.118188:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789023620.118194:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024846720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.118221:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024846720:12345-0@lo:400:kworker.0 Request processed in 28us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023620.118565:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1789023620.118609:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789023620.118615:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023620.118619:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023620.118633:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024846848:0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.118650:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024846464:0@lo:400:kworker.0 00010000:00080000:3.0:1789023620.119745:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76fc000 x1875927024846976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023620.119760:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024846976:0@lo:400:kworker.0 00010000:00080000:3.0:1789023620.119810:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76fdc00 x1875927024846720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023620.119820:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024846720:0@lo:400:kworker.0 00000100:00100000:3.0:1789023620.119831:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024846592:0@lo:400:kworker.0 00000100:00100000:2.0:1789023620.123844:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024846336:0@lo:400:kworker.0 00010000:00010000:1.0:1789023620.361676:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023620.617838:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023620.617859:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024847104:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023620.617919:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023620.617982:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024847104 00000100:00100000:1.0:1789023620.617999:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024847104 00000100:00100000:1.0:1789023620.618056:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789023620.618074:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024847104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023620.618106:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023620.618146:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024847104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023620.618153:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789023620.618190:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c96680 x1875927024847104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023636 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023620.618208:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024847104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789023621.386629:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023621.623040:0:11380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789023622.409848:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023623.154716:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023623.154838:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023623.154876:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023623.154919:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985728 00000100:00100000:3.0:1789023623.154929:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985728 00000100:00100000:3.0:1789023623.154986:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985600 00000100:00100000:3.0:1789023623.154989:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985600 00000100:00100000:3.0:1789023623.155012:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:3.0:1789023623.155021:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006985728:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023623.155108:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006985728:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 88us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023623.155115:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:3.0:1789023623.155133:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:3.0:1789023623.155140:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006985600:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023623.155166:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927006985600:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023623.155171:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00080000:3.0:1789023623.155188:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023623.158792:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985472 00000100:00100000:2.0:1789023623.158804:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985472 00000100:00100000:0.0:1789023623.158994:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:0.0:1789023623.159005:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006985472:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023623.159104:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006985472:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 99us (4395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023623.159112:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 242 00000100:00100000:1.0:1789023623.179336:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789023623.179358:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024847232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023623.179425:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023623.179525:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024847232 00000100:00100000:3.0:1789023623.179534:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024847232 00000100:00100000:3.0:1789023623.179599:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789023623.179608:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024847232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023623.179642:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789023623.179689:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023623.179692:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024847232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023623.179702:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789023623.179721:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c96680 x1875927024847232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023639 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023623.179740:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024847232:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789023623.433730:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023624.463269:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789023624.993020:0:11480:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:00:23 (1789023623) === 00000100:00100000:1.0:1789023625.225832:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024847616:0@lo:400:kworker.0 00000100:00100000:1.0:1789023625.225897:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023625.226068:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024847360:0@lo:400:kworker.0 00000100:00100000:0.0:1789023625.226110:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023625.226139:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024847744:0@lo:400:kworker.0 00000100:00100000:0.0:1789023625.226164:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023625.229897:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024847616 00000100:00100000:0.0:1789023625.229926:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024847872:0@lo:400:kworker.0 00000100:00100000:2.0:1789023625.229929:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024847616 00000100:00100000:0.0:1789023625.229999:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023625.230006:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789023625.230019:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024847616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023625.230051:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789023625.230060:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024847488:0@lo:400:kworker.0 00000100:00100000:0.0:1789023625.230093:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023625.230103:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024847616:12345-0@lo:400:kworker.0 Request processed in 87us (4204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.230112:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789023625.230129:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024847872 00000100:00100000:0.0:1789023625.230131:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024848000:0@lo:400:kworker.0 00000100:00100000:2.0:1789023625.230134:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024847872 00000100:00100000:1.0:1789023625.230152:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024847616:0@lo:400:kworker.0 00000100:00100000:2.0:1789023625.230155:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024847488 00000100:00100000:2.0:1789023625.230157:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024847488 00000100:00100000:2.0:1789023625.230170:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789023625.230175:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024847872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023625.230206:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0070a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024847872:12345-0@lo:400:kworker.0 Request processed in 31us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.230212:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789023625.230222:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789023625.230228:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024847488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023625.230252:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024847488:12345-0@lo:400:kworker.0 Request processed in 25us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.230258:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789023625.230377:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023625.230418:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024847872:0@lo:400:kworker.0 00000100:00100000:1.0:1789023625.230420:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024847744 00000100:00100000:1.0:1789023625.230426:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024847744 00000100:00100000:0.0:1789023625.230440:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024847488:0@lo:400:kworker.0 00000100:00100000:1.0:1789023625.230460:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024848000 00000100:00100000:1.0:1789023625.230464:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024848000 00000100:00100000:0.0:1789023625.230474:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789023625.230517:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024847744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023625.230557:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024847744:12345-0@lo:400:kworker.0 Request processed in 42us (4391us total) trans 0 rc 0/0 00000100:00080000:2.0:1789023625.231371:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023625.231380:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023625.231383:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023625.231868:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024847360 00000100:00100000:2.0:1789023625.231876:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024847360 00000100:00100000:2.0:1789023625.232127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1789023625.232135:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024847360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023625.232202:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024847360:12345-0@lo:400:kworker.0 Request processed in 68us (6091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.232219:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789023625.234070:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789023625.234087:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789023625.234104:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024848000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023625.234168:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024848000:12345-0@lo:400:kworker.0 Request processed in 72us (3792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023625.234174:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789023625.234466:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c97100 x1875927024847744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023625.234515:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024847744:0@lo:400:kworker.0 00010000:00080000:0.0:1789023625.234552:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e3800 x1875927024848000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023625.234581:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024848000:0@lo:400:kworker.0 00000100:00100000:0.0:1789023625.234595:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024847360:0@lo:400:kworker.0 00000100:00100000:3.0:1789023625.253907:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.255841:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985856 00000100:00100000:2.0:1789023625.255856:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985856 00000100:00100000:2.0:1789023625.255950:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789023625.255961:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006985856:12345-192.168.203.48@tcp:41:mkdir.0 00000004:00000024:2.0:1789023625.256007:0:7654:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789023625.256110:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2363:x1875927006985856:12345-192.168.203.48@tcp:41:mkdir.0 Request processed in 150us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.256117:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00080000:1.0:1789023625.256312:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023625.256725:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.256792:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006985984 00000100:00100000:2.0:1789023625.256798:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006985984 00000100:00100000:2.0:1789023625.256835:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1789023625.256843:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:9710:x1875927006985984:12345-192.168.203.48@tcp:700:mkdir.0 00000100:00100000:2.0:1789023625.256887:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:9710:x1875927006985984:12345-192.168.203.48@tcp:700:mkdir.0 Request processed in 46us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.256894:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1789023625.271250:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023625.271431:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006986240 00000100:00100000:0.0:1789023625.271442:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006986240 00000100:00100000:0.0:1789023625.271535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1789023625.271545:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:9710:x1875927006986240:12345-192.168.203.48@tcp:36:mkdir.0 00010000:00010000:0.0:1789023625.271604:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023625.271633:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417c0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf83c expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.271654:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65c6960800) 00010000:00010000:0.0:1789023625.271666:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023625.272345:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.272362:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.272374:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.272387:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.272395:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.272401:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023625.280365:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789023625.280386:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.280397:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.280405:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.280425:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.280430:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.280438:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.280453:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023625.280456:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.280460:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.280467:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023625.280499:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ea877ea reply state 000000008a24ac39 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023625.280508:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789023625.280607:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:9710:x1875927006986240:12345-192.168.203.48@tcp:36:mkdir.0 Request processed in 9059us (9361us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789023625.280616:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00010000:00010000:0.0:1789023625.289941:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.289958:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.289965:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.289971:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023625.289975:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.289982:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.290016:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e65eea05800) 00010000:00010000:0.0:1789023625.290019:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023625.290024:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.290044:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d30 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023625.294453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023625.294555:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006986368 00000100:00100000:0.0:1789023625.294570:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006986368 00000100:00100000:0.0:1789023625.294643:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1789023625.294668:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:9711:x1875927006986368:12345-192.168.203.48@tcp:101:chmod.0 00010000:00010000:0.0:1789023625.294692:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023625.294714:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417d37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8c1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.294788:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3417d3e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.294802:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3417d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.294814:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3417d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023625.294849:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789023625.294853:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023625.294889:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3417d3e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.294931:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417d37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8c1 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.294949:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3417d3e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8c1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.294957:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023625.294960:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023625.294963:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04600, rc 0) 00000100:00100000:0.0:1789023625.295217:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:9711:x1875927006986368:12345-192.168.203.48@tcp:101:chmod.0 Request processed in 372us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023625.295228:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789023625.299085:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.299756:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006986624 00000100:00100000:2.0:1789023625.299768:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006986624 00000100:00100000:2.0:1789023625.299940:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1789023625.299952:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:9711:x1875927006986624:12345-192.168.203.48@tcp:36:chmod.0 00010000:00010000:2.0:1789023625.300006:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023625.300040:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3417d3e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8c1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.300059:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023625.300079:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023625.300103:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.300115:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.300125:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023625.300412:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad909917 reply state 000000002aac55b3 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023625.300422:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789023625.300430:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789023625.300532:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:9711:x1875927006986624:12345-192.168.203.48@tcp:36:chmod.0 Request processed in 583us (1456us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789023625.300540:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00010000:00010000:0.0:1789023625.304152:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.304178:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.304186:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.304193:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023625.304198:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.304205:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.304220:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:0.0:1789023625.304235:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789023625.304240:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.304257:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06800/0xc3c1fcbfb3417d45 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023625.330083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.330181:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006986752 00000100:00100000:2.0:1789023625.330190:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006986752 00000100:00100000:2.0:1789023625.330252:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:2.0:1789023625.330261:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:9712:x1875927006986752:12345-192.168.203.48@tcp:101:chown.0 00010000:00010000:2.0:1789023625.330285:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023625.330305:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8c8 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.330366:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417d53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.330378:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417d53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.330411:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417d53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023625.330442:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023625.330445:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023625.330474:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417d53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.330530:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8c8 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.330547:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417d53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8c8 expref: 8 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.330554:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:2.0:1789023625.330556:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023625.330559:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023625.330711:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:9712:x1875927006986752:12345-192.168.203.48@tcp:101:chown.0 Request processed in 450us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.330717:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789023625.336023:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.336130:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006986880 00000100:00100000:1.0:1789023625.336141:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006986880 00000100:00100000:1.0:1789023625.336207:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:1.0:1789023625.336216:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:9712:x1875927006986880:12345-192.168.203.48@tcp:101:chown.0 00010000:00010000:1.0:1789023625.336236:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023625.336257:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8cf expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336347:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336361:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336372:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336386:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336393:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336399:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336554:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3417d6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336563:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3417d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336569:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3417d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023625.336608:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789023625.336612:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023625.336632:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3417d6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336654:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336662:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336669:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336675:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.336680:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336687:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336698:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:1.0:1789023625.336701:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.336705:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336711:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336722:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336728:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336733:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336742:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.336745:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336750:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336756:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023625.336758:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.336760:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336765:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336792:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8cf expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336804:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3417d6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8cf expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.336810:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023625.336813:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789023625.336815:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023625.336875:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:9712:x1875927006986880:12345-192.168.203.48@tcp:101:chown.0 Request processed in 661us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023625.336882:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789023625.340327:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.340470:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006987136 00000100:00100000:2.0:1789023625.340645:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006987136 00000100:00100000:2.0:1789023625.340737:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1789023625.340747:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:9712:x1875927006987136:12345-192.168.203.48@tcp:36:chown.0 00010000:00010000:2.0:1789023625.340795:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023625.340817:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3417d6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8cf expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.340867:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:2.0:1789023625.340877:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023625.340899:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.340910:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.340920:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789023625.382138:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:1.0:1789023625.382168:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1789023625.382299:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007fdac2c1 reply state 000000003815399d transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023625.382312:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789023625.382326:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1789023625.382434:0:7654:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789023625.382526:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:9712:x1875927006987136:12345-192.168.203.48@tcp:36:chown.0 Request processed in 41767us (42192us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789023625.382536:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00010000:00010000:1.0:1789023625.383466:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.383491:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.383498:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.383504:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.383509:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.383525:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.383540:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:1.0:1789023625.383542:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789023625.383548:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.383555:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07000/0xc3c1fcbfb3417d76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023625.407831:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.408098:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006987264 00000100:00100000:1.0:1789023625.408109:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006987264 00000100:00100000:1.0:1789023625.408172:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789023625.408182:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:9713:x1875927006987264:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:1.0:1789023625.408204:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023625.408223:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8d6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789023625.409800:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1282us 00010000:00010000:1.0:1789023625.425853:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.425876:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.425887:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.425902:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.425909:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.425920:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427213:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3417d92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427229:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3417d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427237:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3417d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023625.427626:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789023625.427631:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023625.427672:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3417d92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427697:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427704:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427711:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427716:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.427720:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427727:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:1.0:1789023625.427740:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.427744:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427749:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417d84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427759:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427765:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427770:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427862:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.427866:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427872:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427882:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023625.427884:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.427887:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427893:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417d8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427931:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8d6 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427945:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3417d92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8d6 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.427952:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023625.427955:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789023625.427957:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707ec00, rc 0) 00000100:00100000:1.0:1789023625.428069:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:9713:x1875927006987264:12345-192.168.203.48@tcp:101:touch.500 Request processed in 19887us (20245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023625.428078:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789023625.435262:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.436137:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006987520 00000100:00100000:1.0:1789023625.436159:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006987520 00000100:00100000:1.0:1789023625.436249:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:1.0:1789023625.436260:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:9713:x1875927006987520:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:1.0:1789023625.436288:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023625.436308:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d99 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8dd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.437123:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.437142:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.437154:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.437170:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.437177:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.437184:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789023625.438400:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1789023625.440756:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb3417dae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.440779:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb3417dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.440813:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb3417dae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.440855:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.440861:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.440868:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.440873:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.440877:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.440884:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.441012:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023625.441016:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.441022:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.441043:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417da0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023625.441059:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b8d55a07 reply state 00000000826e7718 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023625.441067:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789023625.441112:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417d99 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8dd expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.441128:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb3417dae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8dd expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.441135:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65eea05800) 00010000:00010000:1.0:1789023625.441138:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023625.441140:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f200, rc 0) 00000100:00100000:1.0:1789023625.441421:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:9713:x1875927006987520:12345-192.168.203.48@tcp:101:touch.500 Request processed in 5161us (6166us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789023625.441429:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00010000:00010000:0.0:1789023625.445038:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.445055:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.445062:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.445068:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023625.445072:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.445192:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.445228:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff8e65eea05b00) 00010000:00010000:0.0:1789023625.445231:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023625.445236:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.445242:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3417da7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023625.451056:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.451400:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006987776 00000100:00100000:2.0:1789023625.451410:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006987776 00000100:00100000:2.0:1789023625.451468:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789023625.451512:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:9713:x1875927006987776:12345-192.168.203.48@tcp:36:touch.500 00010000:00010000:2.0:1789023625.451565:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023625.451596:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb3417dae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8dd expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.451625:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65eea05800) 00010000:00010000:2.0:1789023625.451636:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023625.451676:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.451689:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.451699:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023625.451842:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000107a5adf reply state 000000007457890a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023625.451851:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023625.451954:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:9713:x1875927006987776:12345-192.168.203.48@tcp:36:touch.500 Request processed in 476us (906us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789023625.451961:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00010000:00010000:1.0:1789023625.456423:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.456442:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.456450:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.456457:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.456462:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.456469:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.456522:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:1.0:1789023625.456525:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.456545:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.456551:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb3417dbc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023625.459331:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023625.459522:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006987904 00000100:00100000:0.0:1789023625.459532:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006987904 00000100:00100000:0.0:1789023625.459580:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789023625.459595:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:9713:x1875927006987904:12345-192.168.203.48@tcp:101:touch.500 00010000:00010000:0.0:1789023625.459625:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023625.459645:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417dc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8e4 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.459702:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8e4 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.459716:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417dc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8e4 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023625.459734:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65c8ebda00) 00010000:00010000:0.0:1789023625.459737:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789023625.459741:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05400, rc 0) 00000100:00100000:0.0:1789023625.459796:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:9713:x1875927006987904:12345-192.168.203.48@tcp:101:touch.500 Request processed in 207us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023625.459817:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:2.0:1789023625.466207:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023625.466433:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006988032 00000100:00100000:3.0:1789023625.466444:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006988032 00000100:00100000:0.0:1789023625.466532:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1789023625.466556:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1875927006988032:12345-192.168.203.48@tcp:8:touch.500 00010000:00080000:0.0:1789023625.466589:0:7164:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp t0 exp 0000000000000000 cur 291 last 0 00000020:00000080:2.0:1789023625.466867:0:7164:0:(genops.c:1384:class_connect()) connect: client fa0f4aba-40ac-42f8-b5d5-b35db811ced7, cookie 0xc3c1fcbfb3417dca 00002000:00100000:2.0:1789023625.466880:0:7164:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fa0f4aba-40ac-42f8-b5d5-b35db811ced7/ffff8e64c13a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789023625.466901:0:7164:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789023625.467765:0:7164:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789023625.467804:0:7164:0:(import.c:65:import_set_state_nolock()) ffff8e65f6c54000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023625.467880:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2360:x1875927006988032:12345-192.168.203.48@tcp:8:touch.500 Request processed in 1323us (1681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.467890:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:2.0:1789023625.473084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.473218:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006988160 00000100:00100000:1.0:1789023625.473228:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006988160 00000100:00100000:1.0:1789023625.473444:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1789023625.473455:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:0:x1875927006988160:12345-192.168.203.48@tcp:2:touch.500 00000100:00080000:2.0:1789023625.474927:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789023625.482505:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789023625.519894:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1789023625.519920:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000100:00100000:1.0:1789023625.520093:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:0:x1875927006988160:12345-192.168.203.48@tcp:2:touch.500 Request processed in 46635us (47014us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789023625.520106:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:3.0:1789023625.522401:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.522999:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006988416 00000100:00100000:2.0:1789023625.523010:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006988416 00000100:00100000:2.0:1789023625.523139:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789023625.523153:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:9713:x1875927006988416:12345-192.168.203.48@tcp:35:touch.500 00000100:00100000:2.0:1789023625.524430:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:9713:x1875927006988416:12345-192.168.203.48@tcp:35:touch.500 Request processed in 1275us (2030us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789023625.524453:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789023625.537308:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.537409:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006988544 00000100:00100000:2.0:1789023625.537419:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006988544 00000100:00100000:2.0:1789023625.537536:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1789023625.537548:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:9714:x1875927006988544:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:2.0:1789023625.537570:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023625.537588:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3417dd1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8eb expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.537650:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417dd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.537664:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.537676:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023625.537708:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023625.537712:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023625.537748:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417dd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.537773:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3417dd1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8eb expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.537791:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417dd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8eb expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.537828:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:2.0:1789023625.537831:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023625.537845:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06e00, rc 0) 00000100:00100000:2.0:1789023625.537941:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:9714:x1875927006988544:12345-192.168.203.48@tcp:101:rm.0 Request processed in 395us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023625.537949:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:0.0:1789023625.548310:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.548522:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006988800 00000100:00100000:2.0:1789023625.548533:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006988800 00000100:00100000:2.0:1789023625.548650:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:2.0:1789023625.548661:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:9714:x1875927006988800:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:2.0:1789023625.548680:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023625.548726:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d800/0xc3c1fcbfb3417ddf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8f2 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023625.548817:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789023625.549012:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d800/0xc3c1fcbfb3417ddf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8f2 expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.549652:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:3.0:1789023625.549657:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789023625.549665:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d800/0xc3c1fcbfb3417ddf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8f2 expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.549694:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d800, rc 0) 00000100:00100000:3.0:1789023625.549765:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:9714:x1875927006988800:12345-192.168.203.48@tcp:101:rm.0 Request processed in 1105us (1470us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1789023625.549772:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:0.0:1789023625.557992:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023625.558331:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006988928 00000100:00100000:3.0:1789023625.558342:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006988928 00000100:00100000:3.0:1789023625.558401:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:3.0:1789023625.558413:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:9714:x1875927006988928:12345-192.168.203.48@tcp:37:rm.0 00000100:00100000:3.0:1789023625.567764:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:9714:x1875927006988928:12345-192.168.203.48@tcp:37:rm.0 Request processed in 9343us (9771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023625.567777:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1789023625.580440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.580605:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006989184 00000100:00100000:2.0:1789023625.580615:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006989184 00000100:00100000:2.0:1789023625.580676:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1789023625.580686:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:9714:x1875927006989184:12345-192.168.203.48@tcp:35:rm.0 00000100:00100000:2.0:1789023625.580908:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9afb850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:9714:x1875927006989184:12345-192.168.203.48@tcp:35:rm.0 Request processed in 223us (476us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789023625.580915:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1789023625.592603:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.592796:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006989440 00000100:00100000:1.0:1789023625.592805:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006989440 00000100:00100000:1.0:1789023625.592867:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:1.0:1789023625.592877:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:9714:x1875927006989440:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:1.0:1789023625.592912:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023625.592933:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417ded lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf8f9 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.593352:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417df4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.593367:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417df4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.593378:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417df4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023625.593406:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789023625.594364:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417ded lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8f9 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.594387:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417df4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8f9 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.594396:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023625.594399:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789023625.594402:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f000, rc 0) 00000100:00100000:1.0:1789023625.594780:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:9714:x1875927006989440:12345-192.168.203.48@tcp:101:rm.0 Request processed in 1903us (2195us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789023625.594790:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789023625.601330:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.601443:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006989568 00000100:00100000:1.0:1789023625.601452:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006989568 00000100:00100000:1.0:1789023625.601522:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1789023625.601532:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:9714:x1875927006989568:12345-192.168.203.48@tcp:41:rm.0 00000004:00000024:1.0:1789023625.601586:0:5846:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789023625.601644:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:9714:x1875927006989568:12345-192.168.203.48@tcp:41:rm.0 Request processed in 115us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023625.601652:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:0.0:1789023625.605921:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023625.609198:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006989696 00000100:00100000:3.0:1789023625.609213:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006989696 00000100:00100000:3.0:1789023625.609287:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1789023625.609298:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:9714:x1875927006989696:12345-192.168.203.48@tcp:101:rm.0 00010000:00010000:3.0:1789023625.609317:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023625.609336:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d800/0xc3c1fcbfb3417e02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf900 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609398:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609412:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609423:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609454:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609461:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609468:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609605:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417e17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609615:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609622:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023625.609645:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789023625.609649:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023625.609665:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609677:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417e17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609684:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609691:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609708:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609714:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023625.609718:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609726:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609738:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:3.0:1789023625.609741:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023625.609745:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609751:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417e09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609776:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609782:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609788:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609793:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023625.609796:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609811:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609820:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff8e65c6960c00) 00010000:00010000:3.0:1789023625.609822:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023625.609825:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609832:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c600/0xc3c1fcbfb3417e10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609863:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d800/0xc3c1fcbfb3417e02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf900 expref: 18 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609874:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417e17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf900 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.609881:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65c8ebda00) 00010000:00010000:3.0:1789023625.609883:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789023625.609886:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d200, rc 0) 00000100:00100000:3.0:1789023625.609958:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:9714:x1875927006989696:12345-192.168.203.48@tcp:101:rm.0 Request processed in 654us (4038us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023625.609966:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:0.0:1789023625.615402:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.615510:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006989952 00000100:00100000:1.0:1789023625.615520:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006989952 00000100:00100000:1.0:1789023625.615706:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789023625.615718:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:9714:x1875927006989952:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:1.0:1789023625.615786:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789023625.615811:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3417e17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf900 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615830:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417dc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8e4 expref: 16 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615842:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65c8ebda00) 00010000:00010000:1.0:1789023625.615856:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417dd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8eb expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615864:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023625.615867:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023625.615886:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615899:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615908:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615919:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615926:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.615932:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.616253:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.616264:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.616271:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789023625.618242:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789023625.618257:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 291688778594ns, next at 292688775511ns, rc = 0 00010000:00010000:1.0:1789023625.618324:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618340:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618350:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618358:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618364:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618370:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618462:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023625.618525:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618551:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618558:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618564:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.618569:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618576:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618587:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:1.0:1789023625.618591:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789023625.618595:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618601:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417e2c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618619:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618625:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618630:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618634:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.618643:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618649:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618656:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023625.618658:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.618661:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.618666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3417e1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023625.618675:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000033d7c51e reply state 000000000f999ca8 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023625.618682:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789023625.618753:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:9714:x1875927006989952:12345-192.168.203.48@tcp:36:rm.0 Request processed in 3035us (3358us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1789023625.618763:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00010000:00010000:2.0:1789023625.619237:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023625.619244:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.619251:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023625.619255:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.619274:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.619284:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:2.0:1789023625.619287:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789023625.619290:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.619297:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3417e33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023625.619311:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023625.619312:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023625.619314:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023625.623184:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.623205:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.623237:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.623244:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023625.623249:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.623260:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.623278:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x74bc947d (ffff8e65eea05300) 00010000:00010000:3.0:1789023625.623284:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023625.623289:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023625.623298:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3417e25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x74bc947d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023625.624334:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023625.624380:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006990208 00000100:00100000:2.0:1789023625.624391:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006990208 00000100:00100000:2.0:1789023625.624451:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1789023625.624461:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:9714:x1875927006990208:12345-192.168.203.48@tcp:35:rm.0 00000100:00100000:2.0:1789023625.625164:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:9714:x1875927006990208:12345-192.168.203.48@tcp:35:rm.0 Request processed in 703us (835us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789023625.625173:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1789023625.628171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023625.628255:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006990464 00000100:00100000:1.0:1789023625.628264:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006990464 00000100:00100000:1.0:1789023625.628320:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:1.0:1789023625.628331:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:9714:x1875927006990464:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:1.0:1789023625.628387:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789023625.628411:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f000/0xc3c1fcbfb3417df4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8f9 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628433:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3417d92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8d6 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628464:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023625.628511:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417d53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8c8 expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628521:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:1.0:1789023625.628528:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023625.628549:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628562:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628570:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628580:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628586:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628604:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628835:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628845:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.628862:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023625.629424:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789023625.629439:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629446:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629452:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629458:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ea00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.629462:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629470:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629507:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e65eea05600) 00010000:00010000:1.0:1789023625.629510:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789023625.629514:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629520:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417e48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629539:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629545:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629557:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629562:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.629565:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629570:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629578:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05f00) 00010000:00010000:1.0:1789023625.629580:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.629583:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.629589:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3417e3a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023625.629600:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ccb5eac reply state 0000000006f86090 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023625.629609:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789023625.629677:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:9714:x1875927006990464:12345-192.168.203.48@tcp:36:rm.0 Request processed in 1346us (1512us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789023625.629684:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00010000:00010000:1.0:1789023625.634855:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.634875:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.634905:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.634912:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023625.634917:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.634927:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.634946:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023625.634949:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023625.634954:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023625.634963:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3417e41 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023625.737882:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024848128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023625.737958:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023625.738197:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024848128 00000100:00100000:1.0:1789023625.738206:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024848128 00000100:00100000:1.0:1789023625.738425:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789023625.738436:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024848128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023625.738475:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023625.738569:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024848128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023625.738576:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789023625.738833:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e0e00 x1875927024848128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023641 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023625.738853:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024848128:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023626.507100:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023627.529709:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023628.271690:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023628.271736:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023628.271770:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023628.271809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023628.271849:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006990720 00000100:00100000:0.0:1789023628.271858:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006990720 00000100:00100000:0.0:1789023628.271914:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006990976 00000100:00100000:0.0:1789023628.271918:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006990976 00000100:00100000:0.0:1789023628.271941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:0.0:1789023628.271950:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:2361:x1875927006990720:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023628.272032:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:2361:x1875927006990720:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 82us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023628.272052:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:0.0:1789023628.272069:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:0.0:1789023628.272075:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927006990976:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023628.272100:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927006990976:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023628.272106:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00080000:0.0:1789023628.272125:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023628.272210:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006990592 00000100:00100000:2.0:1789023628.272216:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006990592 00000100:00100000:2.0:1789023628.272282:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:2.0:1789023628.272291:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006990592:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023628.272334:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006990592:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 46us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023628.272341:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 244 00000100:00100000:3.0:1789023628.272620:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006990848 00000100:00100000:3.0:1789023628.272625:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006990848 00000100:00100000:3.0:1789023628.272706:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:3.0:1789023628.272715:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927006990848:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023628.272748:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927006990848:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 36us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023628.272765:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00080000:0.0:1789023628.272873:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023628.297760:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024848256:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789023628.297764:0:6848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 294368285377ns, next at 295368283289ns, rc = 0 00000100:00100000:0.0:1789023628.297827:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023628.300543:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024848256 00000100:00100000:1.0:1789023628.300579:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024848256 00000100:00100000:1.0:1789023628.300817:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789023628.300828:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024848256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023628.300863:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023628.300946:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024848256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023628.300952:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1789023628.301041:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e2300 x1875927024848256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023644 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023628.301062:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024848256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789023628.301148:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789023628.553660:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789023629.185996:0:11633:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1789023629.577566:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789023630.079779:0:11681:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe54b1bad0 20000000:00000080:1.0:1789023630.079798:0:11681:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e65e7595000 uarg=0000000000000000 20000000:01000000:1.0:1789023630.079874:0:11681:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789023630.079881:0:11681:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789023630.079886:0:11681:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789023630.080602:0:11682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789023630.080767:0:11681:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789023630.088841:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789023630.088899:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789023630.088956:0:11681:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789023630.088972:0:11681:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789023630.088991:0:11681:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089020:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089028:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089034:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089055:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089062:0:11681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089069:0:11681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089106:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089121:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 12 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.089137:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848384:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023630.089241:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089250:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 12 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.089259:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848512:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023630.089287:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089295:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 18 pid: 5840 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.089315:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848640:0@lo:104: 00000100:00100000:0.0:1789023630.089353:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789023630.089387:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089396:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 18 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.089405:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848768:0@lo:104: 00000100:00100000:0.0:1789023630.089425:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789023630.089444:0:11681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.089452:0:11681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 18 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.089460:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848896:0@lo:104: 00000100:00100000:0.0:1789023630.089510:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023630.089523:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023630.089618:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789023630.089634:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024848640 00000100:00100000:3.0:1789023630.089640:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024848640 00000100:00100000:3.0:1789023630.089672:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024848768 00000100:00100000:3.0:1789023630.089674:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024848768 00000100:00100000:3.0:1789023630.089683:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024848896 00000100:00100000:3.0:1789023630.089685:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024848896 00000100:00100000:3.0:1789023630.089698:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023630.089705:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+5:11681:x1875927024848640:12345-0@lo:104: 00010000:00010000:3.0:1789023630.089717:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.089771:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789023630.089777:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+5:11681:x1875927024848640:12345-0@lo:104: Request processed in 72us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.089784:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789023630.089800:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789023630.089806:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:11681:x1875927024848768:12345-0@lo:104: 00010000:00010000:3.0:1789023630.089813:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.089847:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789023630.089852:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+4:11681:x1875927024848768:12345-0@lo:104: Request processed in 47us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.089865:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789023630.089880:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023630.089885:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:11681:x1875927024848896:12345-0@lo:104: 00010000:00010000:3.0:1789023630.089894:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.089927:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789023630.089932:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6ba0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+3:11681:x1875927024848896:12345-0@lo:104: Request processed in 47us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.089937:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1789023630.089973:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789023630.089979:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.089986:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713de00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023630.089990:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090008:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023630.090016:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023630.090022:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023630.090050:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090057:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023630.090083:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090091:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417d0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417d14 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090101:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789023630.090104:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090109:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fd400 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023630.090112:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090119:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023630.090125:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023630.090130:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023630.090143:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090149:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023630.090155:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090162:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fd400/0xc3c1fcbfb3417cff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417d06 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090170:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023630.090178:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090184:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fc600 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023630.090187:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090194:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023630.090200:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023630.090205:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023630.090216:0:7645:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090222:0:7645:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023630.090235:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090242:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc600/0xc3c1fcbfb3417cf1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3417cf8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090254:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023630.090256:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023630.090258:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023630.090264:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023630.090281:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024849024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023630.090310:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023630.090338:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023630.090350:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024849152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023630.090371:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023630.090394:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024849280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023630.090415:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023630.090443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849024 00000100:00100000:3.0:1789023630.090447:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849024 00010000:00010000:3.0:1789023630.090464:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 19 pid: 5840 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023630.090511:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849152 00000100:00100000:3.0:1789023630.090515:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849152 00010000:00010000:3.0:1789023630.090525:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 20 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023630.090535:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849280 00000100:00100000:3.0:1789023630.090537:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849280 00010000:00010000:3.0:1789023630.090545:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 21 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023630.090555:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789023630.090561:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+21:3310:x1875927024849024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023630.090570:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023630.090575:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 21 pid: 5840 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090583:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 21 pid: 5840 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090597:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023630.090623:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+21:3310:x1875927024849024:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.090636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789023630.090651:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789023630.090656:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+20:3310:x1875927024849152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023630.090663:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023630.090668:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 20 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090675:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 20 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090685:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023630.090705:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+20:3310:x1875927024849152:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.090711:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789023630.090722:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789023630.090727:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d725a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024849280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023630.090734:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023630.090739:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 19 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090746:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 19 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.090754:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023630.090777:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d725a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024849280:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.090783:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789023630.090836:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024849280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023630.090869:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024849152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023630.090875:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024849024:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023630.091069:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023630.091160:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc800/0xc3c1fcbfb3417d14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417d0d expref: 18 pid: 5840 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.091171:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848640:0@lo:104: 00010000:00010000:0.0:1789023630.091180:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3417d06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cff expref: 17 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.091189:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848768:0@lo:104: 00010000:00010000:0.0:1789023630.091197:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e707e000/0xc3c1fcbfb3417cf8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3417cf1 expref: 16 pid: 5839 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023630.091211:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848896:0@lo:104: 00000100:00100000:0.0:1789023630.093540:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023630.093860:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848384:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023630.093872:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e61f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11681:1875927024848512:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023630.093903:0:11681:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023630.094163:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006991104 00000100:00100000:3.0:1789023630.094170:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006991104 00010000:00010000:3.0:1789023630.094204:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 13 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023630.094245:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:3.0:1789023630.094254:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006991104:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023630.094266:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023630.094272:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 13 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.094282:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 13 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.094296:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fc000/0xc3c1fcbfb3417d1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8b3 expref: 13 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.094309:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023630.094365:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:2361:x1875927006991104:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 112us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.094373:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1789023630.101851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023630.101945:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006991232 00000100:00100000:3.0:1789023630.101955:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006991232 00010000:00010000:3.0:1789023630.102069:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 12 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023630.102167:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1789023630.102178:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:2362:x1875927006991232:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023630.102193:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023630.102198:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 12 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102210:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 12 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102226:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fde00/0xc3c1fcbfb3417d22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf8ba expref: 12 pid: 5840 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102241:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102249:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102275:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102283:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102291:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102297:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102313:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023630.102318:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102326:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102350:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023630.102362:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023630.102418:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:2362:x1875927006991232:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 241us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023630.102426:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00010000:00010000:0.0:1789023630.102820:0:11681:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.102830:0:11681:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023630.102837:0:11681:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3417e4f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023630.347865:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024849792:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.347940:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023630.348016:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789023630.348023:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024849408:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.348100:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023630.348120:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024849920:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.348142:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023630.348180:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849792 00000100:00100000:2.0:1789023630.348187:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849792 00000100:00100000:2.0:1789023630.348234:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849408 00000100:00100000:2.0:1789023630.348238:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849408 00000100:00100000:2.0:1789023630.348261:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789023630.348270:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875927024849792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.348320:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875927024849792:12345-0@lo:400:kworker.0 Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023630.348327:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789023630.348345:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789023630.348351:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024849408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.348376:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875927024849408:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023630.348396:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789023630.348416:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849920 00000100:00100000:2.0:1789023630.348420:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849920 00000100:00100000:2.0:1789023630.348447:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789023630.348454:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024849920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.348512:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024849920:12345-0@lo:400:kworker.0 Request processed in 58us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023630.349686:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789023630.349719:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023630.349724:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023630.349761:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875927024849408:0@lo:400:kworker.0 00010000:00080000:2.0:1789023630.349776:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76fb800 x1875927024849920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023630.349786:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024849920:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.349797:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024849792:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.349847:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024849664:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.349886:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023630.349960:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023630.349969:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024849536:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.350004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023630.350042:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849664 00000100:00100000:2.0:1789023630.350047:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849664 00000100:00100000:2.0:1789023630.350089:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789023630.350098:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024849664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.350144:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024849664:12345-0@lo:400:kworker.0 Request processed in 48us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023630.350160:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789023630.350183:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789023630.350204:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e76f9f80 x1875927024849664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023630.350213:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024849664:0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.350232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024849536 00000100:00100000:2.0:1789023630.350235:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024849536 00000100:00100000:2.0:1789023630.350267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789023630.350274:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024849536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023630.350316:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024849536:12345-0@lo:400:kworker.0 Request processed in 41us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023630.350322:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789023630.350343:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023630.350363:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024849536:0@lo:400:kworker.0 00000004:00080000:0.0:1789023630.380931:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789023630.380958:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1789023630.380965:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1789023630.381216:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024850048:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789023630.381285:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023630.381443:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850048 00000100:00100000:1.0:1789023630.381451:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850048 00000100:00100000:1.0:1789023630.381532:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023630.381542:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024850048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789023630.381768:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789023630.381805:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa25589, atime: 0x6aa25589, ctime: 0x6aa25589, blocks: 0x1 00010000:00010000:1.0:1789023630.381813:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023630.381843:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=296s v=(0 0) 00010000:00010000:1.0:1789023630.381848:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023630.381854:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023630.381873:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023630.381883:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023630.381892:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023630.381913:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789023630.382517:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875927024850048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 975us (1230us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789023630.382526:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789023630.382666:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023630.382673:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023630.382683:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fe00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023630.382687:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023630.382696:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023630.382722:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023630.382730:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b940a736/0xc3c1fcbfb3417e56 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023630.382748:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023630.382751:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023630.382752:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789023630.382931:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65e77e2300/2, rc 0, transno 4294967300 00000100:00100000:0.0:1789023630.382938:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024850048:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789023630.602676:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023630.858021:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023630.858043:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024850176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023630.858117:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023630.858172:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850176 00000100:00100000:1.0:1789023630.858179:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850176 00000100:00100000:1.0:1789023630.858231:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789023630.858864:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024850176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023630.858898:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023630.859322:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024850176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1082us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023630.859330:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789023630.859399:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65e77e0e00 x1875927024850176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023646 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023630.859420:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024850176:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1789023630.929752:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:0.0:1789023631.345034:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023631.345185:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006991360 00000100:00100000:2.0:1789023631.345195:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006991360 00000100:00100000:2.0:1789023631.345256:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 245 00000100:00100000:2.0:1789023631.345267:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:5602:x1875927006991360:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023631.345282:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023631.345301:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3417e5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf907 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.345330:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3417e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf907 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.345342:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3417e5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf907 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.345349:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07200, rc 0) 00000100:00100000:2.0:1789023631.345408:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006991360:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 143us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.345429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 245 00000100:00100000:2.0:1789023631.350459:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023631.352769:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006991488 00000100:00100000:0.0:1789023631.352784:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006991488 00000100:00100000:0.0:1789023631.352852:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 246 00000100:00100000:0.0:1789023631.353799:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006991488:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023631.354229:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006991488:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 439us (3779us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023631.354238:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 246 00000100:00100000:0.0:1789023631.367045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023631.367144:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006991616 00000100:00100000:1.0:1789023631.367154:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006991616 00000100:00100000:1.0:1789023631.367207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 247 00000100:00100000:1.0:1789023631.367216:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006991616:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.367432:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006991616:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 216us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.367440:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 247 00000100:00100000:3.0:1789023631.373116:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023631.373440:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006991744 00000100:00100000:2.0:1789023631.373451:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006991744 00000100:00100000:2.0:1789023631.373553:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 248 00000100:00100000:2.0:1789023631.373563:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:9985:x1875927006991744:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789023631.373924:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:9985:x1875927006991744:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 362us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.373932:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 248 00000100:00100000:2.0:1789023631.384919:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023631.385200:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006991872 00000100:00100000:0.0:1789023631.385224:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006991872 00000100:00100000:0.0:1789023631.385314:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:0.0:1789023631.385326:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:9985:x1875927006991872:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789023631.385605:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:9985:x1875927006991872:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 282us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023631.385613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 249 00000100:00100000:1.0:1789023631.389148:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023631.389576:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992000 00000100:00100000:2.0:1789023631.389586:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992000 00000100:00100000:2.0:1789023631.389640:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:2.0:1789023631.389650:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+12:5602:x1875927006992000:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023631.389666:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023631.389682:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d07000/0xc3c1fcbfb3417e64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf90e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.389707:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d07000/0xc3c1fcbfb3417e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf90e expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.389718:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d07000/0xc3c1fcbfb3417e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf90e expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.389728:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07000, rc 0) 00000100:00100000:2.0:1789023631.389917:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006992000:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 267us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.389935:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 250 00000100:00100000:3.0:1789023631.391863:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023631.391923:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992128 00000100:00100000:1.0:1789023631.391932:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992128 00000100:00100000:1.0:1789023631.391980:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:1.0:1789023631.392001:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006992128:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.392368:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0112c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006992128:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 378us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.392375:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 251 00000100:00100000:3.0:1789023631.402838:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023631.402939:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992256 00000100:00100000:0.0:1789023631.402949:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992256 00000100:00100000:0.0:1789023631.403014:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:0.0:1789023631.403025:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006992256:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023631.403240:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:5602:x1875927006992256:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 216us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023631.403248:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 252 00000100:00100000:2.0:1789023631.410029:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023631.410352:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992384 00000100:00100000:1.0:1789023631.410362:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992384 00000100:00100000:1.0:1789023631.410416:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:1.0:1789023631.410425:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:9988:x1875927006992384:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023631.410716:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0111850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:9988:x1875927006992384:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 292us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.410723:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 253 00000100:00100000:3.0:1789023631.414017:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023631.414826:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992512 00000100:00100000:2.0:1789023631.414930:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992512 00000100:00100000:2.0:1789023631.414998:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 254 00000100:00100000:2.0:1789023631.415010:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:9988:x1875927006992512:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789023631.415756:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0113050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:9988:x1875927006992512:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 747us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.415765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 254 00010000:00010000:3.0:1789023631.627151:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789023631.817656:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789023631.817663:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65fc5ee000 from 7 10000000:01000000:3.0:1789023631.817668:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789023631.817716:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.817727:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.817756:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023631.817782:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.817851:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.817973:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1c82900 going to sleep for 11 seconds 00000100:00100000:0.0:1789023631.818513:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850304 00000100:00100000:0.0:1789023631.818522:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850304 00000100:00100000:0.0:1789023631.818735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789023631.818746:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:5843:x1875927024850304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023631.818761:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023631.818787:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3417e72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417e6b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023631.818812:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3417e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e6b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023631.818824:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3417e72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e6b expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023631.818848:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04e00, rc 0) 00000100:00100000:0.0:1789023631.819504:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0110850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024850304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 757us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023631.819512:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789023631.819694:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023631.819713:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.819724:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023631.819788:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.819819:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.819855:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1c82900 going to sleep for 11 seconds 00000100:00100000:2.0:1789023631.820028:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850432 00000100:00100000:2.0:1789023631.820034:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850432 00000100:00100000:2.0:1789023631.820612:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789023631.820624:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024850432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023631.820919:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0953c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024850432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 289us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.820926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789023631.821010:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.821058:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.821112:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.822373:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1c82900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023631.822491:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850560 00000100:00100000:1.0:1789023631.822500:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850560 00000100:00100000:1.0:1789023631.822537:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789023631.822704:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024850560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.823084:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0950c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024850560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 538us (1969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.823092:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789023631.823439:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.826416:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11696:1875927024850688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023631.826524:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023631.826575:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c2554840 going to sleep for 11 seconds 00000100:00100000:2.0:1789023631.826902:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850688 00000100:00100000:2.0:1789023631.826976:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850688 00000100:00100000:2.0:1789023631.827038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789023631.827048:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:11696:x1875927024850688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023631.828013:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:11696:x1875927024850688:12345-0@lo:502:llog_process_th.0 Request processed in 962us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.828023:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789023631.828506:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11696:1875927024850688:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023631.828746:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023631.828758:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023631.828760:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789023631.828768:0:11696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e65fc5ee000 00000020:00000080:0.0:1789023631.828771:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789023631.828864:0:11696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e63100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11696:1875927024850816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023631.828922:0:11696:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023631.828960:0:11696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023631.830321:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850816 00000100:00100000:1.0:1789023631.830331:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850816 00000100:00100000:1.0:1789023631.830517:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789023631.830529:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:11696:x1875927024850816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023631.830774:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:11696:x1875927024850816:12345-0@lo:502:llog_process_th.0 Request processed in 247us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.830783:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789023631.832174:0:11696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e63100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11696:1875927024850816:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023631.832214:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023631.832222:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023631.832225:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789023631.832230:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789023631.832566:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789023631.832589:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789023631.832601:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.832619:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023631.832630:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789023631.832634:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d089d800 from 7 10000000:01000000:3.0:1789023631.832636:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789023631.832665:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.832675:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.832685:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023631.832720:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.832774:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.832811:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c8dac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023631.840056:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024850944 00000100:00100000:2.0:1789023631.840472:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024850944 00000100:00100000:2.0:1789023631.840557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789023631.840568:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+17:5843:x1875927024850944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023631.840583:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023631.840601:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d06800/0xc3c1fcbfb3417e80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417e79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.840625:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d06800/0xc3c1fcbfb3417e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e79 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.840636:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d06800/0xc3c1fcbfb3417e80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e79 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023631.840645:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06800, rc 0) 00000100:00100000:2.0:1789023631.840713:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024850944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (7938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.840720:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789023631.841184:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024850944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023631.841207:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.841218:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023631.841283:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.841319:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.841366:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c8dac300 going to sleep for 11 seconds 00000100:00100000:1.0:1789023631.841463:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851072 00000100:00100000:1.0:1789023631.841470:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851072 00000100:00100000:1.0:1789023631.841541:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789023631.841550:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024851072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.841785:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024851072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.841800:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789023631.842060:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.842091:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.842127:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023631.842743:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851200 00000100:00100000:1.0:1789023631.842750:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851200 00000100:00100000:3.0:1789023631.842763:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c8dac300 going to sleep for 11 seconds 00000100:00100000:1.0:1789023631.842793:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789023631.842802:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024851200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.843134:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024851200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 333us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.843142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789023631.843268:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.843754:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11699:1875927024851328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023631.843799:0:11699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.843868:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c8dac900 going to sleep for 11 seconds 00000100:00100000:2.0:1789023631.843883:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851328 00000100:00100000:2.0:1789023631.843890:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851328 00000100:00100000:2.0:1789023631.843929:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789023631.843938:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:11699:x1875927024851328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023631.844110:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:11699:x1875927024851328:12345-0@lo:502:llog_process_th.0 Request processed in 173us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023631.844117:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789023631.844199:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11699:1875927024851328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023631.844221:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023631.844235:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023631.844237:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789023631.844243:0:11699:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e65d089d800 00000020:00000080:3.0:1789023631.844246:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789023631.844309:0:11699:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11699:1875927024851456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023631.844341:0:11699:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.844361:0:11699:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c8dac900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023631.844680:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851456 00000100:00100000:1.0:1789023631.844686:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851456 00000100:00100000:1.0:1789023631.844717:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789023631.844724:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:11699:x1875927024851456:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023631.844858:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:11699:x1875927024851456:12345-0@lo:502:llog_process_th.0 Request processed in 134us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.844865:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789023631.844946:0:11699:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11699:1875927024851456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023631.844968:0:11699:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023631.844973:0:11699:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023631.844975:0:11699:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789023631.844979:0:11699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789023631.845156:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789023631.845175:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789023631.845185:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023631.845195:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023631.845204:0:5843:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789023631.845207:0:5843:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65d252c800 from 7 10000000:01000000:1.0:1789023631.845210:0:5843:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789023631.845232:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023631.845246:0:5843:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023631.845255:0:5843:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023631.845268:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.845294:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023631.845862:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c2554cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023631.845942:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851584 00000100:00100000:3.0:1789023631.845948:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851584 00000100:00100000:3.0:1789023631.846000:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789023631.846016:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+18:5843:x1875927024851584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023631.846027:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023631.846040:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3417e8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3417e87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.846062:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3417e8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e87 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.846073:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3417e8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e87 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023631.846082:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d800, rc 0) 00000100:00100000:3.0:1789023631.846125:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024851584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023631.846132:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789023631.846223:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023631.846238:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023631.846248:0:5843:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023631.846298:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.846446:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023631.846503:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c2554cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023631.846562:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851712 00000100:00100000:3.0:1789023631.846567:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851712 00000100:00100000:3.0:1789023631.846585:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789023631.846591:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024851712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.846772:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024851712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 179us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023631.846778:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789023631.846792:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.846818:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023631.846854:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023631.846883:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c2554cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023631.846930:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851840 00000100:00100000:3.0:1789023631.846934:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851840 00000100:00100000:3.0:1789023631.846960:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789023631.846966:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024851840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.847111:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:5843:x1875927024851840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023631.847129:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789023631.849050:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e77e0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72bd38e6-1e7e-4158-85a3-542824dd2807:5843:1875927024851840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023631.852748:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11700:1875927024851968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023631.852827:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023631.852915:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1c82900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023631.853539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024851968 00000100:00100000:1.0:1789023631.853548:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024851968 00000100:00100000:1.0:1789023631.853599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789023631.853609:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:11700:x1875927024851968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023631.853837:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:11700:x1875927024851968:12345-0@lo:502:llog_process_th.0 Request processed in 229us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.853846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789023631.854016:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11700:1875927024851968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023631.854049:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789023631.854059:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023631.854068:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789023631.854075:0:11700:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e65d252c800 00000020:00000080:2.0:1789023631.854078:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789023631.854216:0:11700:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11700:1875927024852096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023631.854252:0:11700:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023631.854283:0:11700:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1c82900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023631.854638:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852096 00000100:00100000:1.0:1789023631.854644:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852096 00000100:00100000:1.0:1789023631.854679:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789023631.854688:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:11700:x1875927024852096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023631.854829:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:11700:x1875927024852096:12345-0@lo:502:llog_process_th.0 Request processed in 142us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023631.854837:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1789023631.854921:0:11700:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72bd38e6-1e7e-4158-85a3-542824dd2807:11700:1875927024852096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789023631.854943:0:11700:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789023631.854947:0:11700:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789023631.854949:0:11700:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789023631.854953:0:11700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789023631.855112:0:5843:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789023631.855131:0:5843:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789023631.855140:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023631.855152:0:5843:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023631.858468:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789023632.651074:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789023632.918095:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789023633.389292:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023633.389514:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023633.389557:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023633.389583:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023633.389612:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992896 00000100:00100000:1.0:1789023633.389622:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992896 00000100:00100000:1.0:1789023633.389691:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:1.0:1789023633.389701:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927006992896:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023633.389765:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927006992896:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 67us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023633.389773:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:1.0:1789023633.389794:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992768 00000100:00100000:1.0:1789023633.389798:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992768 00000100:00100000:1.0:1789023633.389819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993024 00000100:00100000:1.0:1789023633.389822:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993024 00000100:00100000:1.0:1789023633.389839:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:1.0:1789023633.389845:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927006992768:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023633.389872:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927006992768:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023633.389878:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:1.0:1789023633.389889:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:1.0:1789023633.389895:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2362:x1875927006993024:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023633.389918:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2362:x1875927006993024:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023633.389924:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00080000:2.0:1789023633.390287:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023633.390292:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023633.392820:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006992640 00000100:00100000:0.0:1789023633.392834:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006992640 00000100:00100000:0.0:1789023633.392912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 270 00000100:00100000:0.0:1789023633.392927:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006992640:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023633.393021:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927006992640:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 98us (3507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023633.393028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 270 00000100:00100000:2.0:1789023633.417731:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024852224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023633.417802:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023633.417948:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852224 00000100:00100000:3.0:1789023633.417958:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852224 00000100:00100000:3.0:1789023633.418527:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789023633.418665:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024852224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023633.418704:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789023633.421001:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023633.422556:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000100:00100000:3.0:1789023633.422567:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024852224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3901us (4758us total) trans 0 rc 0/0 00000004:00080000:2.0:1789023633.422567:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65e77e2300, transno 4294967300 00000100:00100000:3.0:1789023633.422582:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789023633.423570:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024852224:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789023633.675610:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023634.699108:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023635.472697:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024852480:0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.472783:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023635.472844:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024852992:0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.472870:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023635.472902:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023635.472908:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024852608:0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.472929:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023635.472980:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852992 00000100:00100000:0.0:1789023635.472987:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852992 00000100:00100000:0.0:1789023635.473053:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789023635.473063:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024852992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.473114:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024852992:12345-0@lo:400:kworker.0 Request processed in 53us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023635.473121:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789023635.473146:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852480 00000100:00100000:0.0:1789023635.473150:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852480 00000100:00100000:0.0:1789023635.473173:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852608 00000100:00100000:0.0:1789023635.473176:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852608 00000100:00100000:0.0:1789023635.473195:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789023635.473200:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024852480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.473229:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024852480:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023635.473236:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789023635.473248:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789023635.473254:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024852608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.473281:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024852608:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023635.473294:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1789023635.473320:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023635.473325:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023635.473354:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024852608:0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.473364:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024852480:0@lo:400:kworker.0 00010000:00080000:0.0:1789023635.473375:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6e62d80 x1875927024852992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023635.473384:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024852992:0@lo:400:kworker.0 00000100:00100000:1.0:1789023635.473459:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024852352:0@lo:400:kworker.0 00000100:00100000:1.0:1789023635.473523:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023635.473546:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024852864:0@lo:400:kworker.0 00000100:00100000:1.0:1789023635.473567:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023635.473583:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023635.473596:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024852736:0@lo:400:kworker.0 00000100:00100000:1.0:1789023635.473620:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023635.473645:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852736 00000100:00100000:1.0:1789023635.473649:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852736 00000100:00100000:1.0:1789023635.473677:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789023635.473683:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024852736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023635.473715:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024852736:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023635.473720:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789023635.473747:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024852736:0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.474567:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852352 00000100:00100000:0.0:1789023635.474576:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852352 00000100:00100000:0.0:1789023635.474615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789023635.474622:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024852352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.474670:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024852352:12345-0@lo:400:kworker.0 Request processed in 48us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023635.474676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00080000:0.0:1789023635.474785:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023635.474798:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024852864 00000100:00100000:0.0:1789023635.474801:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024852864 00000100:00100000:0.0:1789023635.474834:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789023635.474841:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024852864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023635.474873:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024852864:12345-0@lo:400:kworker.0 Request processed in 33us (1304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023635.474879:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1789023635.474895:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023635.476527:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024852352:0@lo:400:kworker.0 00000100:00100000:1.0:1789023635.476548:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024852864:0@lo:400:kworker.0 00010000:00010000:3.0:1789023635.721695:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023635.979794:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024853120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023635.979891:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023635.980722:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024853120 00000100:00100000:1.0:1789023635.980732:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024853120 00000100:00100000:1.0:1789023635.980786:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789023635.980795:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024853120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023635.980828:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023635.980885:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024853120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023635.980892:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789023635.980932:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c95180 x1875927024853120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023651 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023635.980952:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024853120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023636.745717:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023637.769761:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023638.513303:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023638.513342:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023638.513374:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023638.513471:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023638.513690:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993280 00000100:00100000:2.0:1789023638.513701:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993280 00000100:00100000:2.0:1789023638.513761:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993536 00000100:00100000:2.0:1789023638.513765:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993536 00000100:00100000:2.0:1789023638.513786:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:2.0:1789023638.513796:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006993280:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023638.513876:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006993280:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 68us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023638.513898:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:2.0:1789023638.513915:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:2.0:1789023638.513921:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006993536:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023638.513958:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006993536:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023638.513964:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00080000:1.0:1789023638.514072:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023638.516086:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993152 00000100:00100000:3.0:1789023638.516171:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993152 00000100:00100000:3.0:1789023638.516281:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 272 00000100:00100000:3.0:1789023638.516291:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006993152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023638.516349:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006993152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 60us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023638.516357:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 272 00000100:00100000:0.0:1789023638.516439:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993408 00000100:00100000:0.0:1789023638.516445:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993408 00000100:00100000:0.0:1789023638.517250:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:0.0:1789023638.517264:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006993408:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023638.517509:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006993408:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 248us (4164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023638.517517:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00080000:1.0:1789023638.518265:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023638.538983:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023638.539007:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024853248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023638.539076:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023638.539716:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024853248 00000100:00100000:1.0:1789023638.539726:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024853248 00000100:00100000:1.0:1789023638.539838:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789023638.539859:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024853248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023638.539904:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023638.539979:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024853248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023638.539986:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789023638.540151:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024853248:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789023638.541590:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789023638.798047:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023639.817792:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023640.586677:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024853760:0@lo:400:kworker.0 00000100:00100000:1.0:1789023640.586745:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023640.586853:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024853376:0@lo:400:kworker.0 00000100:00100000:3.0:1789023640.586898:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023640.586955:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024853888:0@lo:400:kworker.0 00000100:00100000:3.0:1789023640.586979:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023640.587014:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024853376 00000100:00100000:3.0:1789023640.587021:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024853376 00000100:00100000:3.0:1789023640.587064:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789023640.587073:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024853376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023640.587119:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024853376:12345-0@lo:400:kworker.0 Request processed in 47us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023640.587126:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789023640.587157:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024853888 00000100:00100000:3.0:1789023640.587161:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024853888 00000100:00100000:3.0:1789023640.587194:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789023640.587200:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024853888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023640.587231:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024853888:12345-0@lo:400:kworker.0 Request processed in 31us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023640.587237:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789023640.587273:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024853376:0@lo:400:kworker.0 00000100:00100000:3.0:1789023640.587287:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024853888:0@lo:400:kworker.0 00000100:00080000:0.0:1789023640.587314:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023640.587347:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024853632:0@lo:400:kworker.0 00000100:00100000:0.0:1789023640.587376:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023640.587399:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789023640.587408:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024853504:0@lo:400:kworker.0 00000100:00100000:1.0:1789023640.587432:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024853760 00000100:00100000:0.0:1789023640.587433:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023640.587439:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024853760 00000100:00100000:0.0:1789023640.587456:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024854016:0@lo:400:kworker.0 00000100:00100000:1.0:1789023640.587510:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789023640.587519:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023640.587524:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024853760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023640.587555:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024853632 00000100:00100000:0.0:1789023640.587561:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024853632 00000100:00100000:1.0:1789023640.587577:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024853760:12345-0@lo:400:kworker.0 Request processed in 59us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023640.587584:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789023640.587591:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024853504 00000100:00100000:0.0:1789023640.587596:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024853504 00000100:00100000:1.0:1789023640.587602:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854016 00000100:00100000:1.0:1789023640.587608:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854016 00000100:00100000:0.0:1789023640.587620:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789023640.587634:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024853632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023640.587642:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789023640.587652:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024854016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023640.587677:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024853632:12345-0@lo:400:kworker.0 Request processed in 49us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023640.587684:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789023640.587698:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024854016:12345-0@lo:400:kworker.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023640.587710:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789023640.587719:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789023640.587730:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024853504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023640.587761:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024853504:12345-0@lo:400:kworker.0 Request processed in 43us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023640.587767:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1789023640.587784:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023640.587787:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789023640.587789:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023640.587824:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024853504:0@lo:400:kworker.0 00010000:00080000:0.0:1789023640.587836:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2780a80 x1875927024854016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023640.587845:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024854016:0@lo:400:kworker.0 00000100:00100000:0.0:1789023640.587853:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024853632:0@lo:400:kworker.0 00000100:00100000:3.0:1789023640.587925:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024853760:0@lo:400:kworker.0 00010000:00010000:1.0:1789023640.843143:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023641.098916:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023641.098947:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024854144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023641.099080:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023641.099154:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854144 00000100:00100000:3.0:1789023641.099171:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854144 00000100:00100000:3.0:1789023641.099223:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789023641.099232:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024854144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023641.099265:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023641.099334:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024854144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023641.099341:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1789023641.099429:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65de0fdc00 x1875927024854144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023657 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023641.099523:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024854144:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023641.865677:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789023642.122327:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789023642.890612:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023643.628247:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023643.628303:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023643.628339:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023643.628372:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023643.628403:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993920 00000100:00100000:0.0:1789023643.628412:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993920 00000100:00100000:0.0:1789023643.628472:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:0.0:1789023643.628522:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006993920:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023643.628584:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006993920:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 66us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023643.628591:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00080000:0.0:1789023643.628610:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023643.628878:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993792 00000100:00100000:1.0:1789023643.628884:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993792 00000100:00100000:1.0:1789023643.628933:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994048 00000100:00100000:1.0:1789023643.628936:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994048 00000100:00100000:1.0:1789023643.628956:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:1.0:1789023643.628963:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006993792:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023643.628999:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006993792:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 37us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023643.629006:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:1.0:1789023643.629021:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:1.0:1789023643.629027:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006994048:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023643.629043:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006993664 00000100:00100000:3.0:1789023643.629047:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006993664 00000100:00100000:1.0:1789023643.629050:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927006994048:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 23us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023643.629055:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:3.0:1789023643.629073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 274 00000100:00100000:3.0:1789023643.629079:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927006993664:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023643.629105:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927006993664:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023643.629111:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 274 00000100:00080000:0.0:1789023643.629280:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023643.657742:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789023643.660527:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024854272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789023643.660605:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023643.661006:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854272 00000100:00100000:2.0:1789023643.661014:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854272 00000100:00100000:2.0:1789023643.661081:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789023643.661090:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024854272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023643.661122:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023643.661167:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024854272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023643.661174:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789023643.661757:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024854272:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789023643.662078:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789023643.914269:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023644.940211:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023645.705734:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024854400:0@lo:400:kworker.0 00000100:00100000:3.0:1789023645.705774:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024854656:0@lo:400:kworker.0 00000100:00100000:0.0:1789023645.705850:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024854784:0@lo:400:kworker.0 00000100:00100000:2.0:1789023645.706096:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024854528:0@lo:400:kworker.0 00000100:00100000:3.0:1789023645.710934:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023645.711035:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854656 00000100:00100000:3.0:1789023645.711044:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854656 00000100:00100000:3.0:1789023645.711109:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789023645.711315:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024854656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023645.711373:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024854656:12345-0@lo:400:kworker.0 Request processed in 256us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023645.711381:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789023645.711495:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024854656:0@lo:400:kworker.0 00000100:00080000:3.0:1789023645.711528:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023645.713569:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023645.713630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854400 00000100:00100000:1.0:1789023645.713639:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854400 00000100:00100000:1.0:1789023645.713677:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789023645.713686:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023645.713748:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024854400:12345-0@lo:400:kworker.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023645.713754:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789023645.713814:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024854400:0@lo:400:kworker.0 00000100:00100000:1.0:1789023645.713839:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024854912:0@lo:400:kworker.0 00000100:00100000:1.0:1789023645.713867:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023645.714023:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854912 00000100:00100000:1.0:1789023645.714028:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854912 00000100:00100000:1.0:1789023645.714075:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789023645.714081:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024854912:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789023645.714101:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023645.714963:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024854912:12345-0@lo:400:kworker.0 Request processed in 881us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023645.714970:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789023645.714982:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024854912:0@lo:400:kworker.0 00000100:00100000:0.0:1789023645.715093:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023645.715446:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854784 00000100:00100000:1.0:1789023645.715452:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854784 00000100:00100000:1.0:1789023645.715512:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789023645.715519:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024854784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023645.715564:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024854784:12345-0@lo:400:kworker.0 Request processed in 45us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023645.715570:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:3.0:1789023645.715675:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023645.715805:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024854784:0@lo:400:kworker.0 00000100:00100000:2.0:1789023645.719370:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023645.719428:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024855040:0@lo:400:kworker.0 00000100:00100000:2.0:1789023645.719493:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023645.719611:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024854528 00000100:00100000:3.0:1789023645.719620:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024854528 00000100:00100000:3.0:1789023645.719676:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789023645.719685:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024854528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023645.719757:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024854528:12345-0@lo:400:kworker.0 Request processed in 73us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023645.719764:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789023645.719986:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855040 00000100:00100000:0.0:1789023645.719991:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855040 00000100:00100000:0.0:1789023645.720038:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789023645.720045:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024855040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023645.720080:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024855040:12345-0@lo:400:kworker.0 Request processed in 36us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023645.720086:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1789023645.720147:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789023645.720876:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024854528:0@lo:400:kworker.0 00010000:00080000:1.0:1789023645.720890:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c841ed80 x1875927024855040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023661 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023645.720924:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024855040:0@lo:400:kworker.0 00010000:00010000:1.0:1789023645.962545:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023646.221352:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023646.221374:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024855168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023646.221433:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023646.221647:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855168 00000100:00100000:3.0:1789023646.221657:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855168 00000100:00100000:3.0:1789023646.221708:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789023646.221716:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024855168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023646.222331:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023646.222402:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024855168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 686us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023646.222410:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789023646.222957:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65de0fe680 x1875927024855168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023662 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023646.222978:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024855168:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789023646.985801:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023648.009732:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023648.756284:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023648.756334:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023648.756398:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994176 00000100:00100000:3.0:1789023648.756414:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994176 00000100:00100000:3.0:1789023648.756548:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 276 00000100:00100000:3.0:1789023648.756560:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006994176:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023648.756937:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994304 00000100:00100000:1.0:1789023648.756949:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994304 00000100:00100000:1.0:1789023648.757039:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:1.0:1789023648.757055:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006994304:12345-192.168.203.48@tcp:400:kworker.0 00000100:00080000:2.0:1789023648.757125:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023648.757142:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927006994304:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 91us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023648.757152:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:3.0:1789023648.758285:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006994176:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 1716us (2000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023648.758300:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 276 00000100:00100000:3.0:1789023648.778351:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789023648.778388:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023648.778536:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023648.778865:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855296 00000100:00100000:1.0:1789023648.778892:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855296 00000100:00080000:2.0:1789023648.778972:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023648.779140:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023648.779262:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023648.779552:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789023648.779567:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024855296:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023648.779719:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994560 00000100:00100000:3.0:1789023648.779730:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994560 00000100:00100000:3.0:1789023648.779813:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:3.0:1789023648.779824:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927006994560:12345-192.168.203.48@tcp:400:kworker.0 00002000:00000024:1.0:1789023648.779831:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023648.779918:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927006994560:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 95us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023648.779926:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:1.0:1789023648.779972:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024855296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 406us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023648.779983:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789023648.780006:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2781f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023648.780187:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994432 00000100:00100000:2.0:1789023648.780193:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994432 00000100:00100000:2.0:1789023648.780246:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789023648.780254:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2360:x1875927006994432:12345-192.168.203.48@tcp:9:kworker.0 00000020:00000080:2.0:1789023648.780278:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417dca 00000100:00080000:2.0:1789023648.780290:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8e65f6c54000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789023648.780344:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789023648.780671:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+2:2360:x1875927006994432:12345-192.168.203.48@tcp:9:kworker.0 Request processed in 417us (1535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023648.780678:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00080000:2.0:1789023648.780701:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789023648.780705:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789023648.781233:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023649.034442:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023650.057828:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023650.825822:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024855808:0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.825932:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023650.826012:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789023650.826020:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024855424:0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.826052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023650.826155:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024855936:0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.826187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023650.826219:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024855552:0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.826243:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023650.826262:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024856064:0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.826282:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023650.826311:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023650.826317:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024855680:0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.826355:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023650.826394:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855808 00000100:00100000:2.0:1789023650.826403:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855808 00000100:00100000:3.0:1789023650.826537:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855936 00000100:00100000:3.0:1789023650.826542:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855936 00000100:00100000:2.0:1789023650.827197:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856064 00000100:00100000:2.0:1789023650.827202:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856064 00000100:00100000:3.0:1789023650.831951:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855552 00000100:00100000:3.0:1789023650.831971:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855552 00000100:00100000:3.0:1789023650.832002:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855680 00000100:00100000:3.0:1789023650.832005:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855680 00000100:00100000:3.0:1789023650.832031:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789023650.832042:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875927024855936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023650.833029:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875927024855936:12345-0@lo:400:kworker.0 Request processed in 983us (6835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023650.833041:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789023650.833073:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789023650.833082:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024855552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.833358:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024855936:0@lo:400:kworker.0 00000100:00100000:2.0:1789023650.833401:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789023650.833413:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024855808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023650.833508:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024855552:12345-0@lo:400:kworker.0 Request processed in 427us (7262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023650.833515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789023650.833540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789023650.833546:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024855680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023650.833578:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024855680:12345-0@lo:400:kworker.0 Request processed in 32us (7237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023650.833583:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789023650.833605:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024855424 00000100:00100000:3.0:1789023650.833611:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024855424 00000100:00100000:3.0:1789023650.833648:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789023650.833654:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024855424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023650.833688:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024855424:12345-0@lo:400:kworker.0 Request processed in 34us (7636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023650.833693:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789023650.833743:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024855808:12345-0@lo:400:kworker.0 Request processed in 334us (7813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023650.833750:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789023650.833777:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024855424:0@lo:400:kworker.0 00000100:00080000:2.0:1789023650.833777:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023650.833782:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023650.833785:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023650.833790:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024855808:0@lo:400:kworker.0 00000100:00100000:3.0:1789023650.833847:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789023650.833853:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024856064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023650.834014:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024855680:0@lo:400:kworker.0 00000100:00100000:1.0:1789023650.834027:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024855552:0@lo:400:kworker.0 00000100:00100000:1.0:1789023650.835375:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024856064:12345-0@lo:400:kworker.0 Request processed in 1514us (9084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023650.835387:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789023650.835495:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65c6dcf800 x1875927024856064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023650.835511:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024856064:0@lo:400:kworker.0 00010000:00010000:3.0:1789023651.085973:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023651.339053:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024856192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023651.339149:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023651.339243:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856192 00000100:00100000:3.0:1789023651.339252:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856192 00000100:00100000:3.0:1789023651.339316:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789023651.339326:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024856192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023651.339372:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023651.339439:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024856192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023651.339466:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789023651.339547:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2780a80 x1875927024856192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023667 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023651.339571:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2780a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024856192:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789023651.430584:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:1.0:1789023651.430597:0:6722:0:(genops.c:885:class_export_put()) final put ffff8e64c13a0000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:2.0:1789023651.432943:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c13a0000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 for lustre-OST0000 00000020:00000080:2.0:1789023651.433653:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65f6c54000 for lustre-OST0000 00010000:00010000:3.0:1789023652.107825:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789023652.365714:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789023653.129708:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023653.869458:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023653.869766:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023653.869797:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994944 00000100:00100000:2.0:1789023653.869806:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994944 00000100:00100000:2.0:1789023653.869877:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:2.0:1789023653.869889:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006994944:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023653.869971:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2364:x1875927006994944:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023653.869980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00080000:2.0:1789023653.870003:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023653.871131:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994688 00000100:00100000:3.0:1789023653.871139:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994688 00000100:00100000:1.0:1789023653.871325:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 278 00000100:00100000:1.0:1789023653.871336:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006994688:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023653.871344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023653.871471:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2364:x1875927006994688:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 136us (2019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023653.871508:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 278 00000100:00100000:2.0:1789023653.871941:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006994816 00000100:00100000:2.0:1789023653.871947:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006994816 00000100:00100000:2.0:1789023653.872000:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:2.0:1789023653.872008:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006994816:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023653.872048:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927006994816:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 40us (707us total) trans 0 rc 0/0 00000100:00080000:3.0:1789023653.872132:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023653.872229:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:3.0:1789023653.905769:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024856320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023653.905837:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023653.908278:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856320 00000100:00100000:0.0:1789023653.908295:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856320 00000100:00100000:0.0:1789023653.908363:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789023653.908372:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024856320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023653.908408:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789023653.912006:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023653.913046:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024856320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4670us (7202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023653.913073:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789023653.913334:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2783800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024856320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789023654.153639:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023654.579183:0:11866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:00:52 (1789023652) 00010000:00010000:3.0:1789023655.177700:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023655.945882:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024856576:0@lo:400:kworker.0 00000100:00100000:2.0:1789023655.945951:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023655.946007:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024857088:0@lo:400:kworker.0 00000100:00100000:2.0:1789023655.946043:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023655.946084:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023655.946091:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024856704:0@lo:400:kworker.0 00000100:00100000:2.0:1789023655.946113:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023655.946146:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856576 00000100:00100000:2.0:1789023655.946154:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856576 00000100:00100000:2.0:1789023655.946194:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856704 00000100:00100000:2.0:1789023655.946197:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856704 00000100:00100000:2.0:1789023655.946220:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789023655.946227:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024856576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023655.946272:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024856576:12345-0@lo:400:kworker.0 Request processed in 45us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023655.946296:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789023655.946313:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789023655.946319:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024856704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023655.946348:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024856704:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023655.946353:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789023655.946372:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024857088 00000100:00100000:2.0:1789023655.946375:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024857088 00000100:00100000:2.0:1789023655.946403:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789023655.946410:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024857088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023655.946453:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024857088:12345-0@lo:400:kworker.0 Request processed in 43us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023655.946460:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789023655.946530:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024856704:0@lo:400:kworker.0 00000100:00100000:2.0:1789023655.946550:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024856576:0@lo:400:kworker.0 00010000:00080000:2.0:1789023655.946561:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6e62d80 x1875927024857088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789023671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023655.946571:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024857088:0@lo:400:kworker.0 00000100:00100000:1.0:1789023655.946817:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024856448:0@lo:400:kworker.0 00000100:00100000:1.0:1789023655.946861:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023655.946891:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024856960:0@lo:400:kworker.0 00000100:00100000:1.0:1789023655.946911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023655.946927:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023655.946932:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024856832:0@lo:400:kworker.0 00000100:00100000:1.0:1789023655.946949:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789023655.946968:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023655.946972:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023655.946980:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856832 00000100:00100000:1.0:1789023655.946989:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856832 00000100:00100000:1.0:1789023655.947026:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789023655.947033:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024856832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023655.947066:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024856832:12345-0@lo:400:kworker.0 Request processed in 34us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023655.947182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856448 00000100:00100000:2.0:1789023655.947185:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856448 00000100:00100000:2.0:1789023655.947213:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789023655.947219:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024856448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023655.947222:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024856960 00000100:00100000:3.0:1789023655.947226:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024856960 00000100:00100000:2.0:1789023655.947251:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024856448:12345-0@lo:400:kworker.0 Request processed in 31us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023655.947252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789023655.947265:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789023655.947269:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024856960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023655.947313:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024856960:12345-0@lo:400:kworker.0 Request processed in 55us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023655.947320:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789023655.947333:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789023655.947347:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789023655.947349:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023655.947367:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024856832:0@lo:400:kworker.0 00000100:00100000:1.0:1789023655.947376:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024856448:0@lo:400:kworker.0 00000100:00100000:1.0:1789023655.947385:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024856960:0@lo:400:kworker.0 00010000:00010000:3.0:1789023656.201696:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023656.248081:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023656.248537:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006995072 00000100:00100000:2.0:1789023656.248548:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006995072 00000100:00100000:2.0:1789023656.248641:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:2.0:1789023656.248655:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:10256:x1875927006995072:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023656.248687:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023656.248786:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3417e95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf915 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.248934:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3417e9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.248960:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3417e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.248973:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3417e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023656.249015:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023656.249019:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023656.249074:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3417e9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.249113:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3417e95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf915 expref: 7 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.249143:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3417e9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf915 expref: 6 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.249631:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023656.249636:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023656.249640:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023656.249730:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:10256:x1875927006995072:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1060us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023656.249737:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00080000:1.0:1789023656.249916:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023656.258464:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023656.258634:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006995200 00000100:00100000:2.0:1789023656.258644:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006995200 00000100:00100000:2.0:1789023656.258706:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:2.0:1789023656.258717:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:10257:x1875927006995200:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023656.258735:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023656.258755:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3417ea3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf91c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.258816:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.258851:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.258864:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.258920:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.258927:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.258947:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.259887:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3417eb8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.259903:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3417eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.259911:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3417eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023656.259939:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023656.259943:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023656.259960:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3417eb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.259971:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.259978:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.259985:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.259991:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023656.259995:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260003:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260022:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023656.260025:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023656.260030:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260036:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3417eaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260048:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260055:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260061:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260065:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023656.260068:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260073:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260080:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e65f41d1800) 00010000:00010000:2.0:1789023656.260082:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023656.260085:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260091:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3417eb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260136:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3417ea3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf91c expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260150:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3417eb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf91c expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023656.260158:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:2.0:1789023656.260160:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023656.260163:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07600, rc 0) 00000100:00100000:2.0:1789023656.260240:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:10257:x1875927006995200:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1523us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023656.260248:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1789023656.272260:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023656.274789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006995456 00000100:00100000:3.0:1789023656.274805:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006995456 00000100:00100000:3.0:1789023656.274913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1789023656.274925:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:10257:x1875927006995456:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023656.274958:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023656.274978:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ebf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf923 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.275045:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.275059:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.275070:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.275126:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.275134:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.275141:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.277819:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713da00/0xc3c1fcbfb3417ed4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.277854:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713da00/0xc3c1fcbfb3417ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.277865:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713da00/0xc3c1fcbfb3417ed4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023656.277877:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789023656.278096:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278104:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278112:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278118:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023656.278123:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278130:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278142:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:3.0:1789023656.278145:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023656.278150:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278157:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417ec6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278168:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278175:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278180:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278195:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023656.278198:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278205:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278213:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e65c6960c00) 00010000:00010000:3.0:1789023656.278216:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023656.278219:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.278224:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417ecd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.280100:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ebf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf923 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.280126:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713da00/0xc3c1fcbfb3417ed4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf923 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023656.280136:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:3.0:1789023656.280139:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023656.280142:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713da00, rc 0) 00000100:00100000:3.0:1789023656.280214:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:10257:x1875927006995456:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 5291us (7962us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789023656.280224:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:0.0:1789023656.287632:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023656.287837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006995584 00000100:00100000:2.0:1789023656.287847:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006995584 00000100:00100000:2.0:1789023656.287911:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:2.0:1789023656.287921:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:10257:x1875927006995584:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789023656.288027:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:10257:x1875927006995584:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 109us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023656.288035:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000040:00080000:2.0:1789023656.458331:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789023656.460426:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024857216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023656.460545:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023656.460705:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024857216 00000100:00100000:0.0:1789023656.460715:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024857216 00000100:00100000:0.0:1789023656.460780:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789023656.460793:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024857216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023656.460849:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023656.460915:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024857216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023656.460922:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789023656.460961:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65d2782300 x1875927024857216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023672 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023656.460983:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024857216:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789023657.232705:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023657.962869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023657.962945:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006995712 00000100:00100000:0.0:1789023657.962956:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006995712 00000100:00100000:0.0:1789023657.963022:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789023657.963034:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:10299:x1875927006995712:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023657.963055:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023657.963077:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3417ee2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf92a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963138:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963153:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963177:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963193:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963200:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963207:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963410:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963419:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963426:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963431:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023657.963435:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963443:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963454:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023657.963457:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023657.963462:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963507:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417ee9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963522:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963528:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963534:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963539:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023657.963543:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963548:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963557:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e65c8ebda00) 00010000:00010000:0.0:1789023657.963559:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023657.963562:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963568:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417ef0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963599:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3417ee2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf92a expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963619:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023657.963621:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023657.963625:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3417ee2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf92a expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023657.963635:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05000, rc 0) 00000100:00100000:0.0:1789023657.963835:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:10299:x1875927006995712:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 804us (975us total) trans 0 rc 301/301 00000100:00100000:0.0:1789023657.963844:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789023657.971240:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023657.975661:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006995968 00000100:00100000:3.0:1789023657.975684:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006995968 00000100:00100000:3.0:1789023657.975787:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1789023657.975798:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:10299:x1875927006995968:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:3.0:1789023657.975857:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023657.975883:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3417e9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf915 expref: 9 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.975901:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023657.975913:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023657.976120:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.976133:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.976142:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.976153:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.976159:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.976166:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023657.977027:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789023657.977038:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.977047:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.977061:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.977067:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023657.977072:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.977079:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.977091:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65c6960c00) 00010000:00010000:3.0:1789023657.977094:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023657.977098:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.977104:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ef7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789023657.977121:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b81addfb reply state 000000007ecbd7eb transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023657.977129:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789023657.977251:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:10299:x1875927006995968:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 1453us (6016us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789023657.977260:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00010000:00010000:3.0:1789023657.986458:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.986509:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.986528:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.986534:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023657.986539:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.986548:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.986565:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e65c6960e00) 00010000:00010000:3.0:1789023657.986568:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023657.986572:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023657.986577:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417efe lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023658.070888:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.071107:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006996096 00000100:00100000:2.0:1789023658.071118:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006996096 00000100:00100000:2.0:1789023658.071200:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:2.0:1789023658.071210:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:10308:x1875927006996096:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:2.0:1789023658.071235:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023658.071258:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417f05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf931 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.071323:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417f0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.071335:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.071344:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023658.071630:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023658.071635:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023658.071675:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417f0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.071700:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417f05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf931 expref: 11 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.071717:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417f0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf931 expref: 10 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.071726:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:2.0:1789023658.071741:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023658.071746:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023658.071819:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:10308:x1875927006996096:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 602us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023658.071827:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00080000:1.0:1789023658.072250:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023658.123676:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023658.124263:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006996224 00000100:00100000:0.0:1789023658.124274:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006996224 00000100:00100000:0.0:1789023658.124341:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:0.0:1789023658.124352:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:10314:x1875927006996224:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789023658.124372:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023658.124394:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3417f13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf938 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124457:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124472:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124671:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124704:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124712:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124720:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124829:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04a00/0xc3c1fcbfb3417f28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124838:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04a00/0xc3c1fcbfb3417f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124846:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04a00/0xc3c1fcbfb3417f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023658.124873:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789023658.124891:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023658.124928:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04a00/0xc3c1fcbfb3417f28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124940:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124946:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124952:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124967:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023658.124972:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124979:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.124992:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:0.0:1789023658.124994:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023658.124998:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125004:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3417f1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125018:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125024:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125030:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125035:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023658.125037:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125054:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125072:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e65c8ebda00) 00010000:00010000:0.0:1789023658.125074:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023658.125078:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125084:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3417f21 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125119:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3417f13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf938 expref: 12 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125134:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04a00/0xc3c1fcbfb3417f28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf938 expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.125141:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023658.125143:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789023658.125146:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04a00, rc 0) 00000100:00100000:1.0:1789023658.128034:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:10314:x1875927006996224:12345-192.168.203.48@tcp:101:bash.0 Request processed in 3671us (4354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023658.128049:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789023658.133983:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.134103:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006996480 00000100:00100000:2.0:1789023658.134113:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006996480 00000100:00100000:2.0:1789023658.134181:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:2.0:1789023658.134191:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:10314:x1875927006996480:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023658.134210:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023658.134231:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417f2f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf93f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.134348:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.134363:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.134374:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.136492:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.136514:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.136525:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023658.137122:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789023658.137290:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137300:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137309:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137341:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137349:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137355:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137361:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023658.137365:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137372:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137382:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023658.137385:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023658.137389:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137405:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023658.137420:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec714c37 reply state 000000007b966063 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023658.137427:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789023658.137463:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3417f2f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137532:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.137540:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:2.0:1789023658.137542:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023658.137544:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07400, rc 0) 00000100:00100000:2.0:1789023658.137607:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:10314:x1875927006996480:12345-192.168.203.48@tcp:101:bash.0 Request processed in 3417us (3635us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789023658.137614:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00010000:00010000:1.0:1789023658.143070:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.143089:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023658.143099:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1789023658.143104:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.143112:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023658.143117:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.143139:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.143156:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1200) 00010000:00010000:1.0:1789023658.143159:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023658.143163:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.143169:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3417f3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023658.143225:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006996608 00000100:00100000:2.0:1789023658.143235:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006996608 00000100:00100000:2.0:1789023658.143279:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1789023658.143287:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1875927006996608:12345-192.168.203.48@tcp:8:bash.0 00010000:00080000:2.0:1789023658.143317:0:6696:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:2.0:1789023658.143345:0:6696:0:(genops.c:1384:class_connect()) connect: client fa0f4aba-40ac-42f8-b5d5-b35db811ced7, cookie 0xc3c1fcbfb3417f52 00002000:00100000:2.0:1789023658.143356:0:6696:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fa0f4aba-40ac-42f8-b5d5-b35db811ced7/ffff8e65f6c54000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789023658.143386:0:6696:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789023658.143684:0:6696:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789023658.143717:0:6696:0:(import.c:65:import_set_state_nolock()) ffff8e65f6c50800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023658.144162:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2360:x1875927006996608:12345-192.168.203.48@tcp:8:bash.0 Request processed in 873us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023658.144171:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1789023658.148001:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023658.148076:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006996736 00000100:00100000:3.0:1789023658.148084:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006996736 00000100:00100000:3.0:1789023658.148208:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789023658.148220:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:0:x1875927006996736:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789023658.148239:0:7164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023658.148261:0:7164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf946 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789023658.148289:0:7164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789023658.148306:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1789023658.148317:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023658.148326:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 7 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.148348:0:7164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 7 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.148362:0:7164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c200, rc 0) 00000100:00100000:3.0:1789023658.150921:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:0:x1875927006996736:12345-192.168.203.48@tcp:101:bash.0 Request processed in 2693us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023658.150932:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00080000:1.0:1789023658.151145:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789023658.155923:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.156030:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006996864 00000100:00100000:2.0:1789023658.156040:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006996864 00000100:00100000:2.0:1789023658.156099:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:2.0:1789023658.156110:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:10314:x1875927006996864:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023658.156128:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023658.156151:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf94d expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.156182:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 8 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.156192:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023658.156196:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023658.156201:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.156234:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 8 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.156247:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 8 pid: 7164 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023658.156276:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875927024857344:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023658.156371:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1840 going to sleep for 11 seconds 00000100:00100000:0.0:1789023658.160000:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.160116:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875927024857344:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023658.160149:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.160169:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06e00, rc 0) 00000100:00100000:2.0:1789023658.160232:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:10314:x1875927006996864:12345-192.168.203.48@tcp:101:bash.0 Request processed in 4124us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023658.160242:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:3.0:1789023658.160692:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006996992 00000100:00100000:3.0:1789023658.160700:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006996992 00010000:00010000:3.0:1789023658.160734:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 8 pid: 7164 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023658.160769:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:3.0:1789023658.160779:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927006996992:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023658.160794:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023658.160826:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 8 pid: 7164 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.160839:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 8 pid: 7164 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.160882:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcd2956d/0xc3c1fcbfb3417f59 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf946 expref: 8 pid: 7164 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.160899:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023658.160902:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023658.160910:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.160920:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.160954:0:6710:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023658.160969:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6710:1875927024857472:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789023658.161051:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023658.171456:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.173209:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006997248 00000100:00100000:2.0:1789023658.173222:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006997248 00000100:00100000:2.0:1789023658.173290:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1789023658.173301:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:10314:x1875927006997248:12345-192.168.203.48@tcp:35:bash.0 00000001:00080000:2.0:1789023658.173614:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:2.0:1789023658.173738:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:10314:x1875927006997248:12345-192.168.203.48@tcp:35:bash.0 Request processed in 438us (2290us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789023658.173746:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000020:00080000:2.0:1789023658.173751:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789023658.177970:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6710:1875927024857472:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789023658.178014:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023658.178566:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927006996992:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 17784us (18571us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023658.178578:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00010000:00010000:3.0:1789023658.249737:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023658.261825:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023658.261905:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006997504 00000100:00100000:3.0:1789023658.261915:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006997504 00000100:00100000:3.0:1789023658.261975:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1789023658.261987:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:10324:x1875927006997504:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023658.262011:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023658.262042:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417f67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf954 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023658.262128:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789023658.262261:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417f67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf954 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.262282:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:3.0:1789023658.262285:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789023658.262290:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417f67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf954 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.262303:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c200, rc 0) 00000100:00100000:3.0:1789023658.262361:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:10324:x1875927006997504:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 377us (554us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1789023658.262367:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:0.0:1789023658.268114:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.268263:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006997760 00000100:00100000:2.0:1789023658.268282:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006997760 00000100:00100000:2.0:1789023658.268353:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:2.0:1789023658.268364:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:10324:x1875927006997760:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023658.268838:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:10324:x1875927006997760:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 474us (732us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789023658.268848:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789023658.379110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.379208:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006997888 00000100:00100000:2.0:1789023658.379219:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006997888 00000100:00100000:2.0:1789023658.379274:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:2.0:1789023658.379284:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:10330:x1875927006997888:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023658.379309:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023658.379329:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf95b expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.379798:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3417f7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.379822:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3417f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.379834:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3417f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023658.379868:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789023658.379872:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023658.379890:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3417f7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.379917:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf95b expref: 19 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.379956:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3417f7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf95b expref: 18 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.379964:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023658.379967:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023658.379971:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06a00, rc 0) 00000100:00100000:2.0:1789023658.380031:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10330:x1875927006997888:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 748us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023658.380038:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1789023658.394302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023658.394410:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006998144 00000100:00100000:1.0:1789023658.394430:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006998144 00000100:00100000:1.0:1789023658.394502:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1789023658.394511:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10330:x1875927006998144:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023658.394530:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023658.394550:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb3417f83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf962 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.394660:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417f8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.394675:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.394687:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417f8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023658.394698:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789023658.394843:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb3417f83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf962 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.394863:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417f8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf962 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.394872:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:1.0:1789023658.394875:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023658.394878:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707ee00, rc 0) 00000100:00100000:1.0:1789023658.394943:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:10330:x1875927006998144:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 433us (650us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789023658.394951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1789023658.398234:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.398327:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006998400 00000100:00100000:2.0:1789023658.398347:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006998400 00000100:00100000:2.0:1789023658.398408:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:2.0:1789023658.398425:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:10330:x1875927006998400:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023658.398447:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023658.398467:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf969 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.398607:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417f9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.398622:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417f9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.398632:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417f9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023658.398644:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789023658.398779:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3417f98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf969 expref: 23 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.398797:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417f9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf969 expref: 22 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.398806:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:2.0:1789023658.398820:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789023658.398824:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06400, rc 0) 00000100:00100000:2.0:1789023658.398872:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:10330:x1875927006998400:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 455us (649us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789023658.398879:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1789023658.401691:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023658.401950:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006998528 00000100:00100000:3.0:1789023658.401960:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006998528 00000100:00100000:3.0:1789023658.402067:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:3.0:1789023658.402078:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:2364:x1875927006998528:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023658.402092:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023658.402113:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3417f8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf962 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.402132:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:3.0:1789023658.402137:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023658.402193:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:2364:x1875927006998528:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 117us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023658.402221:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789023658.409112:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.409456:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006998656 00000100:00100000:2.0:1789023658.409467:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006998656 00000100:00100000:2.0:1789023658.409551:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789023658.409561:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927006998656:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:2.0:1789023658.409607:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.409627:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.409635:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023658.409640:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023658.409645:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.409681:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.409718:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 7 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023658.409733:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875927024857600:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023658.410207:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789023658.413408:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875927024857600:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023658.413449:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023658.415275:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.415650:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006998784 00000100:00100000:2.0:1789023658.415660:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006998784 00002000:00100000:2.0:1789023658.415929:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e65e70b2a00 x1875927006998784/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:584/0 lens 504/0 e 0 to 0 dl 1789023669 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789023658.415940:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65e70b2a00 with x1875927006998784 ext(0->12) 00010000:00010000:2.0:1789023658.415950:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 8 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.415966:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 8 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789023658.415974:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65e70b2a00 00000100:00100000:2.0:1789023658.416046:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1789023658.416056:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927006998784:12345-192.168.203.48@tcp:4:lfs.0 00000001:00100000:1.0:1789023658.449962:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000100:00100000:0.0:1789023658.451246:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927006998784:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 35185us (35973us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789023658.451264:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00002000:00100000:0.0:1789023658.451286:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e65e70b2a00 x1875927006998784/t4294967299(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:584/0 lens 504/448 e 0 to 0 dl 1789023669 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023658.451296:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65e70b2a00 with x1875927006998784 ext(0->12) 00010000:00010000:0.0:1789023658.451307:0:6699:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 9 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023658.451326:0:6699:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 9 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023658.451334:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65e70b2a00 00000100:00100000:1.0:1789023658.454375:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.454454:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006998912 00000100:00100000:2.0:1789023658.454470:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006998912 00010000:00010000:2.0:1789023658.454979:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 9 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023658.455083:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:2.0:1789023658.455093:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2364:x1875927006998912:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023658.455109:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789023658.455128:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789023658.455131:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789023658 00002000:00010000:2.0:1789023658.455133:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789023658 00002000:00010000:2.0:1789023658.455136:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789023658 00010000:00010000:2.0:1789023658.455143:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 9 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.455235:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 9 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.455262:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb3417f60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf94d expref: 9 pid: 6696 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.455339:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023658.455343:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023658.455395:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.455421:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.455877:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023658.456103:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2364:x1875927006998912:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1008us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023658.456112:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00010000:00010000:1.0:1789023658.456163:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456173:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456200:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456209:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456217:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456234:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023658.456238:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456247:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456263:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.456280:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005baebdc9/0xc3c1fcbfb3417fad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023658.456332:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927006998656:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 46773us (47230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023658.456340:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1789023658.464073:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023658.466307:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006999168 00000100:00100000:3.0:1789023658.466322:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006999168 00000100:00100000:3.0:1789023658.466466:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789023658.466532:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:10330:x1875927006999168:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:3.0:1789023658.466915:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417f9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf969 expref: 21 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023658.467449:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789023658.467612:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1789023658.468644:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:3.0:1789023658.468964:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.468984:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.468993:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.469030:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.469048:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 25 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023658.469206:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875927024857728:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023658.469364:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023658.476077:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023658.476729:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006999296 00000100:00100000:1.0:1789023658.476739:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006999296 00010000:00010000:1.0:1789023658.476781:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 26 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023658.476835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:1.0:1789023658.476846:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:2362:x1875927006999296:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023658.476861:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023658.476881:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 26 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.476894:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 26 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.476918:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:1.0:1789023658.476923:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.476932:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.476939:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.476958:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023658.477019:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:2362:x1875927006999296:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 174us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023658.477026:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00010000:00010000:3.0:1789023658.478506:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3417f44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf93f expref: 25 pid: 5845 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023658.478533:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875927024857728:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023658.478558:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.478568:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.478575:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023658.478851:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1789023658.479925:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1789023658.480174:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024857856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789023658.480331:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023658.480364:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d72c1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023658.481242:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024857856 00000100:00100000:0.0:1789023658.481252:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024857856 00000100:00100000:0.0:1789023658.481338:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023658.481349:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875927024857856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789023658.481452:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875927024857856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023658.481459:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789023658.482205:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023658.482249:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024857856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789023658.483597:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789023658.483690:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024857984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789023658.483867:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023658.483892:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd9480 going to sleep for 11 seconds 00000100:00100000:0.0:1789023658.483982:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024857984 00000100:00100000:0.0:1789023658.483989:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024857984 00000100:00100000:0.0:1789023658.484038:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023658.484048:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875927024857984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789023658.484270:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875927024857984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 223us (403us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789023658.484286:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023658.484852:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcf480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024857984:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789023658.484916:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789023658.484967:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.484978:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.484987:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.485005:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023658.485010:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.485018:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.485034:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:2.0:1789023658.485037:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789023658.485042:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.485048:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3417fb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023658.485257:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789023658.485894:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789023658.485907:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 324556428477ns, next at 325556425507ns, rc = 0 00000001:00080000:2.0:1789023658.485916:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1789023658.485955:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:2.0:1789023658.485958:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789023658.485967:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417f9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf969 expref: 29 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023658.486073:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+28:10330:x1875927006999168:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 19597us (22019us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1789023658.486090:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000020:00080000:2.0:1789023658.486095:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789023658.490319:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023658.490522:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006999424 00000100:00100000:1.0:1789023658.490533:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006999424 00000100:00100000:1.0:1789023658.490588:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:1.0:1789023658.490599:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+28:10330:x1875927006999424:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023658.490622:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023658.490645:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417fbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf970 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.490700:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf970 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.490910:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417fbb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf970 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.490931:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023658.490935:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023658.490939:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707ea00, rc 0) 00000100:00100000:1.0:1789023658.491049:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:10330:x1875927006999424:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 451us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023658.491066:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:0.0:1789023658.495149:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.495608:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006999680 00000100:00100000:2.0:1789023658.495617:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006999680 00000100:00100000:2.0:1789023658.495819:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1789023658.495840:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:10330:x1875927006999680:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023658.496322:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9af8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:10330:x1875927006999680:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 491us (1180us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1789023658.496330:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789023658.594258:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.594529:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927006999936 00000100:00100000:2.0:1789023658.594539:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927006999936 00000100:00100000:2.0:1789023658.594599:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:2.0:1789023658.594610:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:10340:x1875927006999936:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023658.594633:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023658.594651:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417fc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf977 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023658.594858:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789023658.595507:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417fc2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf977 expref: 32 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.595522:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:2.0:1789023658.595525:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023658.595531:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3417fc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf977 expref: 32 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.595545:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06400, rc 0) 00000100:00100000:2.0:1789023658.595614:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:10340:x1875927006999936:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1005us (1364us total) trans 4294967328 rc 301/301 00000100:00100000:2.0:1789023658.595637:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1789023658.599675:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023658.599820:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007000064 00000100:00100000:3.0:1789023658.599830:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007000064 00000100:00100000:3.0:1789023658.599972:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789023658.599984:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:10340:x1875927007000064:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1789023658.600067:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600084:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600095:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600114:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600140:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600148:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600247:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600256:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600264:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789023658.600331:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600345:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600351:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.600359:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601160:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023658.601168:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601178:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601212:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:3.0:1789023658.601215:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023658.601220:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601226:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417fd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601241:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601248:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601254:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601259:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023658.601261:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601268:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601284:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c6960500) 00010000:00010000:3.0:1789023658.601286:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023658.601289:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601295:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601441:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601449:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601454:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601459:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023658.601462:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601468:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601603:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:3.0:1789023658.601607:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023658.601611:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.601617:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023658.601707:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:10340:x1875927007000064:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1723us (2039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023658.601716:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:0.0:1789023658.605630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.605716:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007000320 00000100:00100000:2.0:1789023658.605726:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007000320 00000100:00100000:2.0:1789023658.605782:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023658.605792:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:10340:x1875927007000320:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023658.606186:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:10340:x1875927007000320:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 392us (563us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1789023658.606691:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1789023658.665007:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023658.665100:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007000576 00000100:00100000:3.0:1789023658.665109:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007000576 00000100:00100000:3.0:1789023658.665171:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:3.0:1789023658.665196:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:10343:x1875927007000576:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023658.665219:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023658.665239:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fe5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf97e expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665309:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665323:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665334:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665347:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665353:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665360:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665463:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665471:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665538:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023658.665557:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789023658.665645:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665652:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665658:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665663:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023658.665667:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665673:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665684:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:3.0:1789023658.665686:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023658.665690:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665696:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3417fec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665707:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665713:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665727:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665731:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023658.665734:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665741:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665748:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c6960500) 00010000:00010000:3.0:1789023658.665750:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023658.665753:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665758:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3417ff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665801:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3417fe5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665827:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.665835:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:3.0:1789023658.665837:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789023658.665840:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713dc00, rc 0) 00000100:00100000:3.0:1789023658.665893:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:10343:x1875927007000576:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 699us (895us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789023658.665908:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1789023658.670438:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023658.670614:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007000704 00000100:00100000:1.0:1789023658.670623:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007000704 00000100:00100000:1.0:1789023658.670686:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:1.0:1789023658.670696:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:10343:x1875927007000704:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1789023658.670759:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670776:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670786:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670821:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670828:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670851:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670857:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023658.670861:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670869:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670881:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023658.670884:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789023658.670888:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023658.670899:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418008 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023658.670963:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:10343:x1875927007000704:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 268us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023658.670970:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:0.0:1789023658.673122:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.673261:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007000960 00000100:00100000:2.0:1789023658.673270:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007000960 00000100:00100000:2.0:1789023658.673350:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789023658.673360:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:10343:x1875927007000960:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023658.673607:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:10343:x1875927007000960:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 248us (492us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789023658.673614:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1789023658.934539:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023658.934648:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007001216 00000100:00100000:3.0:1789023658.934659:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007001216 00000100:00100000:3.0:1789023658.934720:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:3.0:1789023658.934729:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:10374:x1875927007001216:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:3.0:1789023658.934754:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023658.934773:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341800f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf985 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.935334:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418016 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.935350:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.935433:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023658.935445:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789023658.935617:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341800f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf985 expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.935635:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf985 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023658.935643:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:3.0:1789023658.935646:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789023658.935649:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713cc00, rc 0) 00000100:00100000:3.0:1789023658.935973:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:10374:x1875927007001216:12345-192.168.203.48@tcp:101:cat.0 Request processed in 1243us (1443us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789023658.935983:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1789023658.942166:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023658.942259:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007001344 00000100:00100000:2.0:1789023658.942270:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007001344 00000100:00100000:2.0:1789023658.942344:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789023658.942355:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d725b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:2364:x1875927007001344:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023658.942382:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023658.942409:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418016 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf985 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023658.942427:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:2.0:1789023658.942432:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023658.942529:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d725b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+36:2364:x1875927007001344:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 174us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023658.942536:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1789023658.946224:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023658.949898:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007001600 00000100:00100000:1.0:1789023658.949915:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007001600 00000100:00100000:1.0:1789023658.949984:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1789023658.949994:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+36:10374:x1875927007001600:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:1.0:1789023658.950347:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:10374:x1875927007001600:12345-192.168.203.48@tcp:35:cat.0 Request processed in 352us (4130us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789023658.950355:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1789023658.988769:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023658.988823:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023658.989509:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007001856 00000100:00100000:1.0:1789023658.989520:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007001856 00000100:00100000:1.0:1789023658.989597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:1.0:1789023658.989607:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007001856:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023658.989677:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007001856:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 73us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023658.989684:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00080000:2.0:1789023658.989760:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023658.989866:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007001728 00000100:00100000:3.0:1789023658.989871:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007001728 00000100:00100000:3.0:1789023658.989904:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 280 00000100:00100000:3.0:1789023658.989911:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007001728:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023658.989938:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007001728:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023658.989944:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 280 00000100:00100000:0.0:1789023659.008335:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023659.008442:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007002112 00000100:00100000:2.0:1789023659.008452:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007002112 00000100:00100000:2.0:1789023659.008547:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:2.0:1789023659.008557:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:10380:x1875927007002112:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:2.0:1789023659.008581:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023659.008584:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789023659.008606:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3417f7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf95b expref: 37 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.008625:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023659.008629:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023659.008641:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418024 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf98c expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.008730:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.008745:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.008753:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.008783:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.008826:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 37 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023659.008839:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024858112:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023659.008938:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023659.014957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023659.015668:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024858112:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023659.015696:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023659.016126:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007002240 00000100:00100000:1.0:1789023659.016134:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007002240 00010000:00010000:1.0:1789023659.016170:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 38 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023659.016460:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1789023659.016472:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:2361:x1875927007002240:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023659.016574:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023659.016582:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 38 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.016594:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 38 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.016613:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3417ffa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf97e expref: 38 pid: 5845 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.016628:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023659.016633:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.017120:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.017128:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.017159:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023659.017271:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.017280:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023659.017298:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789023659.017456:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418024 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 39 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.017474:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 38 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.017534:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:2.0:1789023659.017536:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789023659.017539:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06e00, rc 0) 00000100:00100000:1.0:1789023659.017615:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:2361:x1875927007002240:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1145us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023659.017624:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1789023659.018014:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024858240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789023659.018289:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:10380:x1875927007002112:12345-192.168.203.48@tcp:101:dd.0 Request processed in 9733us (9962us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789023659.018309:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:1.0:1789023659.018640:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023659.018751:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024858240 00000100:00100000:2.0:1789023659.018758:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024858240 00000100:00100000:2.0:1789023659.018827:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789023659.018836:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024858240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023659.018866:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023659.018923:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024858240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023659.018928:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1789023659.019039:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023659.019425:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024858240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789023659.024364:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023659.025233:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007002496 00000100:00100000:1.0:1789023659.025246:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007002496 00000100:00100000:1.0:1789023659.025340:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1789023659.025350:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:10380:x1875927007002496:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:1.0:1789023659.025637:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.025653:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.025664:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789023659.025712:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:1.0:1789023659.025735:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bb6e3bd0 reply state 00000000743d2c7f transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023659.025754:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789023659.026199:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+40:10380:x1875927007002496:12345-192.168.203.48@tcp:36:dd.0 Request processed in 848us (1842us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1789023659.026208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000020:00080000:1.0:1789023659.026213:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789023659.028319:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.028336:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.028343:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.028349:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023659.028354:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.028362:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.029459:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:3.0:1789023659.029464:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023659.029472:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.029883:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418039 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.274928:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023659.370287:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023659.370525:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007002624 00000100:00100000:3.0:1789023659.370536:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007002624 00000100:00100000:3.0:1789023659.370601:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:3.0:1789023659.370611:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+39:10394:x1875927007002624:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:3.0:1789023659.370634:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023659.370653:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418040 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf993 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.370915:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.370930:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.370941:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.370954:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.370961:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.370967:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.371060:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.371071:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 40 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.371079:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.371112:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 40 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.371125:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 40 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023659.371138:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024858368:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023659.371272:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023659.381556:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024858368:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023659.381589:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023659.383592:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023659.383944:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007002880 00000100:00100000:1.0:1789023659.383955:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007002880 00000100:00100000:1.0:1789023659.384013:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789023659.384142:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:5600:x1875927007002880:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789023659.386254:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:5600:x1875927007002880:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 2107us (2660us total) trans 4294967337 rc 0/0 00000100:00100000:1.0:1789023659.386269:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1789023659.389682:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023659.389822:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007003008 00000100:00100000:0.0:1789023659.389839:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007003008 00010000:00010000:0.0:1789023659.389880:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 42 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023659.389925:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:0.0:1789023659.389949:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:2361:x1875927007003008:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023659.389963:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023659.389970:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 42 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.389984:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 42 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.390005:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb341802b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf98c expref: 42 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.390021:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:0.0:1789023659.390026:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.390036:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.390044:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.390071:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023659.390112:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390122:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023659.390132:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:2361:x1875927007003008:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 184us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023659.390141:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000004:00200000:3.0:1789023659.390168:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789023659.390179:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023659.390224:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390238:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390248:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390254:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390261:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390267:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023659.390272:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390279:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390289:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:3.0:1789023659.390292:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023659.390295:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390300:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390310:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390325:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.390331:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.391584:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023659.391590:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.391599:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.391612:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c6960500) 00010000:00010000:3.0:1789023659.391615:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023659.391619:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.391626:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb341804e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.391743:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418040 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf993 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.391760:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf993 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.391768:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:3.0:1789023659.391771:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789023659.391785:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d400, rc 0) 00000100:00100000:2.0:1789023659.392032:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+40:10394:x1875927007002624:12345-192.168.203.48@tcp:101:stat.0 Request processed in 21419us (21750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023659.392041:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:2.0:1789023659.466413:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023659.466553:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007003264 00000100:00100000:0.0:1789023659.466563:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007003264 00000100:00100000:0.0:1789023659.466626:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:0.0:1789023659.466640:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+40:10400:x1875927007003264:12345-192.168.203.48@tcp:36:truncate.0 00010000:00010000:0.0:1789023659.466708:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023659.466735:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418055 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf993 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.466753:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:0.0:1789023659.466758:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023659.466990:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.467003:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.467012:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789023659.467060:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:0.0:1789023659.467082:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbfd20af reply state 000000008f9d2063 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023659.467090:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789023659.467429:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:10400:x1875927007003264:12345-192.168.203.48@tcp:36:truncate.0 Request processed in 722us (957us total) trans 4294967339 rc 0/0 00000100:00100000:0.0:1789023659.467437:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000020:00080000:0.0:1789023659.467442:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789023659.471631:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.471648:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.471656:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.471662:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023659.471668:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.471684:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.471700:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023659.471716:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023659.471722:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.471728:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341805c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023659.653578:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023659.653649:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007003392 00000100:00100000:0.0:1789023659.653659:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007003392 00000100:00100000:0.0:1789023659.653711:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1789023659.653721:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:10414:x1875927007003392:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:0.0:1789023659.653742:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023659.653772:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf99a expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.653841:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.653854:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.653865:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.653878:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.653893:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.653900:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654044:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654053:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654060:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023659.654093:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789023659.654098:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023659.654120:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654139:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654146:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654152:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654158:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654164:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023659.654168:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654175:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654186:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023659.654189:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023659.654193:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654200:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341806a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654212:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654218:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654230:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654235:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023659.654238:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654244:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654252:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c8ebda00) 00010000:00010000:0.0:1789023659.654254:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023659.654257:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654262:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654293:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 43 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654307:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 42 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.654314:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:0.0:1789023659.654316:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789023659.654318:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04600, rc 0) 00000100:00100000:0.0:1789023659.654390:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:10414:x1875927007003392:12345-192.168.203.48@tcp:101:stat.0 Request processed in 670us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023659.654406:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:0.0:1789023659.755949:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023659.757638:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007003648 00000100:00100000:1.0:1789023659.757651:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007003648 00000100:00100000:1.0:1789023659.757723:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:1.0:1789023659.757733:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:10424:x1875927007003648:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023659.757752:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023659.757773:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb341807f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9a1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023659.757868:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789023659.757975:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb341807f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a1 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.757988:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:1.0:1789023659.757991:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789023659.757996:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb341807f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a1 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.758009:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e200, rc 0) 00000100:00100000:1.0:1789023659.758462:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+43:10424:x1875927007003648:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 728us (2519us total) trans 4294967340 rc 301/301 00000100:00100000:1.0:1789023659.758470:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:1.0:1789023659.764712:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023659.765750:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007003904 00000100:00100000:2.0:1789023659.765764:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007003904 00000100:00100000:2.0:1789023659.765863:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789023659.765874:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+43:10424:x1875927007003904:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023659.766096:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+44:10424:x1875927007003904:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 224us (1393us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1789023659.766104:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789023659.827288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023659.827392:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007004160 00000100:00100000:0.0:1789023659.827402:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007004160 00000100:00100000:0.0:1789023659.827459:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789023659.827470:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e77e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+44:10430:x1875927007004160:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789023659.827513:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023659.827531:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341808d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9a8 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.827627:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.827643:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 45 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.827650:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.827684:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 45 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.827697:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 45 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023659.827893:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024858496:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023659.828041:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f40b2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023659.832128:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023659.832425:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007004288 00000100:00100000:3.0:1789023659.832434:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007004288 00010000:00010000:3.0:1789023659.832471:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 46 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023659.832576:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:3.0:1789023659.832585:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:2361:x1875927007004288:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023659.832599:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023659.832606:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 46 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.832618:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 46 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.832639:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:3.0:1789023659.832644:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.832653:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.832660:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.832688:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023659.832966:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf99a expref: 46 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023659.832968:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:2361:x1875927007004288:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 382us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023659.832984:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:2.0:1789023659.833016:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024858496:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023659.834343:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.834564:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.834572:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023659.834592:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1789023659.835470:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341808d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 46 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.835518:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 45 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.835527:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:2.0:1789023659.835529:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789023659.835533:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04800, rc 0) 00000100:00100000:2.0:1789023659.835596:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e77e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+45:10430:x1875927007004160:12345-192.168.203.48@tcp:101:bash.0 Request processed in 8128us (8316us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789023659.835605:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789023659.839687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023659.839873:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007004544 00000100:00100000:3.0:1789023659.839883:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007004544 00000100:00100000:3.0:1789023659.839941:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:3.0:1789023659.839951:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+45:10430:x1875927007004544:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:3.0:1789023659.840614:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.840631:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.840643:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023659.840843:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:3.0:1789023659.840878:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a626a8b reply state 00000000c254d485 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023659.840887:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789023659.840986:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+48:10430:x1875927007004544:12345-192.168.203.48@tcp:36:bash.0 Request processed in 1035us (1318us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1789023659.840994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000020:00080000:3.0:1789023659.840999:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789023659.844402:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.844417:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.844424:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.844431:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023659.844447:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.844455:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.844514:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:3.0:1789023659.844517:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023659.844522:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023659.844536:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34180a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023659.852683:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023659.852759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007004672 00000100:00100000:2.0:1789023659.852769:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007004672 00000100:00100000:2.0:1789023659.852833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789023659.852844:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:10430:x1875927007004672:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023659.852879:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023659.852898:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9af expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.852990:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.853005:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 48 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.853014:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.853056:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 48 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.853078:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 48 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023659.853092:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024858624:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023659.853182:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd9a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023659.858817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023659.860795:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e63800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024858624:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023659.861298:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007004800 00000100:00100000:1.0:1789023659.861308:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007004800 00010000:00010000:1.0:1789023659.861353:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 49 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023659.861402:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:1.0:1789023659.861412:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:2361:x1875927007004800:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023659.861427:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023659.861434:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 49 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.861446:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 49 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.861467:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418094 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9a8 expref: 49 pid: 7654 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.861521:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023659.861526:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.861535:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.861542:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.861559:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023659.861624:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+48:2361:x1875927007004800:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 213us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023659.861644:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00010000:00010000:2.0:1789023659.861916:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.861927:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.861932:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023659.861982:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789023659.861987:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023659.862006:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.862036:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9af expref: 48 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.862053:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9af expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023659.862060:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:2.0:1789023659.862063:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023659.862066:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06200, rc 0) 00000100:00100000:2.0:1789023659.862102:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:10430:x1875927007004672:12345-192.168.203.48@tcp:101:bash.0 Request processed in 9259us (9436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023659.862109:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:0.0:1789023659.870741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023659.870830:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007005056 00000100:00100000:1.0:1789023659.870848:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007005056 00000100:00100000:1.0:1789023659.870902:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:1.0:1789023659.870912:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:10430:x1875927007005056:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:1.0:1789023659.871137:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9afbc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+48:10430:x1875927007005056:12345-192.168.203.48@tcp:35:bash.0 Request processed in 226us (405us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789023659.871145:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1789023659.987629:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023659.987732:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007005312 00000100:00100000:1.0:1789023659.987742:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007005312 00000100:00100000:1.0:1789023659.987810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:1.0:1789023659.987820:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+48:10440:x1875927007005312:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023659.987856:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023659.987876:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34180b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9b6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023659.987964:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789023659.988095:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34180b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9b6 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.988111:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:1.0:1789023659.988114:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789023659.988119:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34180b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9b6 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023659.988135:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f800, rc 0) 00000100:00100000:1.0:1789023659.988223:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10440:x1875927007005312:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 405us (605us total) trans 4294967346 rc 301/301 00000100:00100000:1.0:1789023659.988230:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789023659.994251:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023659.994601:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007005440 00000100:00100000:0.0:1789023659.994611:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007005440 00000100:00100000:0.0:1789023659.994664:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:0.0:1789023659.994681:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10440:x1875927007005440:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:0.0:1789023659.994748:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.994764:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.994776:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.994790:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.994796:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.994813:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995027:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995036:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995057:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789023659.995098:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995110:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995116:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995123:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995129:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023659.995133:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995140:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995215:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023659.995219:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023659.995225:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995232:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34180c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995245:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995257:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995263:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995268:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023659.995271:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995278:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995286:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c8ebda00) 00010000:00010000:0.0:1789023659.995288:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023659.995291:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995297:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb34180cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995312:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995318:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995323:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995326:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023659.995334:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995340:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995346:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:0.0:1789023659.995349:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023659.995351:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023659.995415:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34180d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023659.995742:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10440:x1875927007005440:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1068us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023659.995750:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:0.0:1789023659.998557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023659.998619:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007005696 00000100:00100000:2.0:1789023659.998628:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007005696 00000100:00100000:2.0:1789023659.998737:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:2.0:1789023659.998748:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10440:x1875927007005696:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023659.999000:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:10440:x1875927007005696:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 254us (449us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789023659.999009:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789023660.055465:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.055632:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007005952 00000100:00100000:1.0:1789023660.055642:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007005952 00000100:00080000:0.0:1789023660.055781:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023660.055789:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1789023660.055815:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:10443:x1875927007005952:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023660.055847:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023660.055868:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34180da lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9bd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.055944:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.055959:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.055970:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.055983:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.055990:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.055996:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056121:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34180ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056140:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34180ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056147:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34180ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023660.056158:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789023660.056251:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056259:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056265:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056271:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023660.056275:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056281:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056293:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:1.0:1789023660.056296:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023660.056301:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056306:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34180e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056318:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056330:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056335:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056339:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023660.056342:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056349:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056366:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65eea05200) 00010000:00010000:1.0:1789023660.056368:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023660.056370:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056374:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34180e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056409:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34180da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9bd expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056418:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34180ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9bd expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.056423:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023660.056424:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023660.056430:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023660.056520:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:10443:x1875927007005952:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 720us (1064us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789023660.056528:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:3.0:1789023660.060789:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.060866:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007006080 00000100:00100000:1.0:1789023660.060876:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007006080 00000100:00100000:3.0:1789023660.060927:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.061022:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007006208 00000100:00100000:2.0:1789023660.061026:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007006208 00000100:00100000:1.0:1789023660.061135:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1789023660.061139:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789023660.061146:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10443:x1875927007006208:12345-192.168.203.48@tcp:54:lfs.0 00000100:00100000:1.0:1789023660.061146:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:2364:x1875927007006080:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023660.061164:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023660.061186:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34180ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9bd expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.061204:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023660.061208:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023660.061217:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.061228:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.061238:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.061261:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023660.061264:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:2364:x1875927007006080:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 120us (485us total) trans 0 rc 0/0 00010000:00010000:2.0:1789023660.061268:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023660.061271:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00010000:00010000:2.0:1789023660.061274:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.061280:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023660.061284:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.061291:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.061299:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:2.0:1789023660.061302:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023660.061306:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.061321:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34180fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023660.061353:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:10443:x1875927007006208:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 208us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.061360:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:0.0:1789023660.064980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.065054:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007006464 00000100:00100000:1.0:1789023660.065074:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007006464 00000100:00100000:1.0:1789023660.065130:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1789023660.065141:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:10443:x1875927007006464:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023660.065516:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:10443:x1875927007006464:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 375us (543us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789023660.065524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:3.0:1789023660.262909:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.263016:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007006720 00000100:00100000:1.0:1789023660.263025:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007006720 00000100:00100000:1.0:1789023660.263093:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1789023660.263117:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:10461:x1875927007006720:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:1.0:1789023660.263140:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023660.263161:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418104 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9c4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.263251:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341810b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.263265:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341810b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.263276:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341810b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023660.263286:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789023660.263729:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418104 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9c4 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.263750:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341810b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9c4 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.263760:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023660.263762:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789023660.263766:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f800, rc 0) 00000100:00100000:1.0:1789023660.263836:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10461:x1875927007006720:12345-192.168.203.48@tcp:101:cat.0 Request processed in 721us (935us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789023660.263843:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00010000:00010000:3.0:1789023660.298288:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023660.310605:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.310709:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007006848 00000100:00100000:0.0:1789023660.310720:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007006848 00000100:00100000:0.0:1789023660.310784:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:0.0:1789023660.310794:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10462:x1875927007006848:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023660.310831:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023660.310851:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9cb expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.310913:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418120 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.310946:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.310958:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023660.310994:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789023660.310998:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023660.311015:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418120 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.311042:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9cb expref: 56 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.311063:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418120 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9cb expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.311071:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023660.311074:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023660.311078:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04400, rc 0) 00000100:00100000:0.0:1789023660.311146:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7253800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10462:x1875927007006848:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 353us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023660.311153:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:2.0:1789023660.317687:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.320978:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007007232 00000100:00100000:1.0:1789023660.320993:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007007232 00000100:00100000:1.0:1789023660.321197:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1789023660.321209:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10462:x1875927007007232:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023660.321764:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10462:x1875927007007232:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 553us (4082us total) trans 4294967351 rc 0/0 00000100:00100000:1.0:1789023660.321773:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789023660.324375:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.324764:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007007360 00000100:00100000:1.0:1789023660.324774:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007007360 00000100:00100000:1.0:1789023660.324962:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1789023660.324974:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10462:x1875927007007360:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:1.0:1789023660.324989:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789023660.325011:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34180b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9af expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.325035:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341810b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9c4 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.325049:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3417fbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf970 expref: 54 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.325058:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05700) 00010000:00010000:1.0:1789023660.325079:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023660.325181:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10462:x1875927007007360:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 208us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023660.325190:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789023660.332012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.332235:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007007488 00000100:00100000:2.0:1789023660.332245:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007007488 00000100:00100000:2.0:1789023660.332301:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:2.0:1789023660.332311:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10462:x1875927007007488:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:2.0:1789023660.332427:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.332442:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.332454:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023660.332758:0:5846:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789023660.332976:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789023660.333037:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789023660.333134:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10462:x1875927007007488:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 823us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.333142:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:2.0:1789023660.360859:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.361471:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007007616 00000100:00100000:0.0:1789023660.361609:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007007616 00000100:00100000:2.0:1789023660.361882:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:2.0:1789023660.361914:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10464:x1875927007007616:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023660.361950:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023660.361978:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341812e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9d2 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362065:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362086:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362097:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362110:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362117:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362135:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362230:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362239:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362254:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023660.362884:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789023660.362889:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023660.362923:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362935:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362943:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362949:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362955:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362960:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023660.362964:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362971:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362982:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023660.362984:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023660.362989:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.362994:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418135 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364007:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364019:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364037:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364044:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023660.364056:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364064:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364076:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1700) 00010000:00010000:2.0:1789023660.364079:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023660.364092:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364099:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341813c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364158:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341812e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364221:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 54 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.364882:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:2.0:1789023660.364885:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023660.364888:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023660.365031:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10464:x1875927007007616:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3115us (4166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.365040:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000040:00080000:3.0:1789023660.554098:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789023660.554108:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789023660.554155:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789023660.554163:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789023660.554279:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7315c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024858752:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789023660.554378:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023660.560203:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7315c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024858752:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789023660.571574:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.571663:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007007744 00000100:00100000:2.0:1789023660.571674:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007007744 00000100:00100000:2.0:1789023660.571733:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1789023660.571743:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10475:x1875927007007744:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789023660.571832:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10475:x1875927007007744:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.571849:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:0.0:1789023660.577091:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.577164:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007007872 00000100:00100000:2.0:1789023660.577174:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007007872 00000100:00100000:2.0:1789023660.577233:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:2.0:1789023660.577245:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10475:x1875927007007872:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789023660.577277:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789023660.577397:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10475:x1875927007007872:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 154us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.577405:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1789023660.584891:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.584981:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007008000 00000100:00100000:1.0:1789023660.584990:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007008000 00000100:00100000:1.0:1789023660.585047:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1789023660.585068:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10475:x1875927007008000:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789023660.585141:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585157:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585169:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585183:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585190:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585196:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585220:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585227:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585234:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023660.585267:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789023660.585271:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023660.585286:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585306:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585312:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585318:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585323:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023660.585327:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585335:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585347:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:1.0:1789023660.585349:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023660.585360:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585366:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341814a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585379:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585384:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585389:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585400:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023660.585404:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585410:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585419:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e65eea05700) 00010000:00010000:1.0:1789023660.585421:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023660.585424:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585429:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418151 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585444:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585452:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585457:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585462:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023660.585465:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585471:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585524:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:1.0:1789023660.585526:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023660.585530:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.585536:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418158 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023660.585606:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10475:x1875927007008000:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 538us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023660.585614:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1789023660.595570:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.595679:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007008256 00000100:00100000:2.0:1789023660.595689:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007008256 00000100:00100000:2.0:1789023660.595742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:2.0:1789023660.595752:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10475:x1875927007008256:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023660.595786:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023660.595817:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341815f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9d9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.595916:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.595930:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.595940:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023660.595951:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789023660.596045:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596052:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596060:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596066:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023660.596070:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596077:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596089:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:2.0:1789023660.596097:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023660.596103:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596110:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418166 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596149:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341815f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d9 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596158:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:2.0:1789023660.596160:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023660.596164:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341815f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d9 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.596174:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06200, rc 0) 00000100:00100000:2.0:1789023660.596233:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10475:x1875927007008256:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 482us (672us total) trans 4294967352 rc 301/301 00000100:00100000:2.0:1789023660.596240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:1.0:1789023660.599246:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.599366:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007008384 00000100:00100000:0.0:1789023660.599511:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007008384 00000100:00100000:0.0:1789023660.599564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:0.0:1789023660.599574:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10475:x1875927007008384:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789023660.599605:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789023660.599888:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10475:x1875927007008384:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 314us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023660.599897:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:0.0:1789023660.604620:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.604761:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007008640 00000100:00100000:2.0:1789023660.604770:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007008640 00000100:00100000:2.0:1789023660.605042:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:2.0:1789023660.605053:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10475:x1875927007008640:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023660.605072:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023660.605075:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789023660.605098:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418120 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9cb expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.605114:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023660.605130:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023660.605143:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418174 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9e0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023660.605579:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789023660.605767:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341817b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.605780:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341817b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.605789:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341817b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.605860:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418174 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e0 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.605875:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341817b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e0 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.605881:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023660.605884:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023660.605886:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07a00, rc 0) 00000100:00100000:2.0:1789023660.605943:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10475:x1875927007008640:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 893us (1332us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789023660.605951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:3.0:1789023660.610157:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.610254:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007008896 00000100:00100000:2.0:1789023660.610264:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007008896 00000100:00100000:2.0:1789023660.610382:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:2.0:1789023660.610392:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10475:x1875927007008896:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789023660.610468:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023660.610522:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341817b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e0 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610540:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023660.610552:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023660.610573:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610585:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610591:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610646:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610651:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610655:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610715:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610722:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610728:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610741:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023660.610746:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610753:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610762:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023660.610765:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023660.610769:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610775:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418189 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610785:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610803:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610809:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610813:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023660.610816:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610822:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610851:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x8498bee8 (ffff8e65f41d1a00) 00010000:00010000:2.0:1789023660.610854:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023660.610857:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.610862:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418190 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x8498bee8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023660.610940:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10475:x1875927007008896:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 545us (789us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023660.610948:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:0.0:1789023660.612635:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023660.612770:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007009024 00000100:00100000:3.0:1789023660.612780:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007009024 00000100:00100000:3.0:1789023660.612851:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:3.0:1789023660.612862:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10475:x1875927007009024:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023660.612880:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023660.612900:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418197 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9e7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.612933:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.612947:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.612957:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.613053:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418197 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.613070:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.613078:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:3.0:1789023660.613081:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789023660.613091:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d000, rc 0) 00000100:00100000:3.0:1789023660.613150:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10475:x1875927007009024:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 290us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023660.613157:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:3.0:1789023660.617431:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.618580:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007009280 00000100:00100000:0.0:1789023660.618592:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007009280 00000100:00100000:0.0:1789023660.618809:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:0.0:1789023660.618822:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10475:x1875927007009280:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789023660.618956:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.618971:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.618982:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789023660.619244:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789023660.619253:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 326689774548ns, next at 327689772693ns, rc = 0 00000004:00010000:0.0:1789023660.619334:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000057c586e2 reply state 00000000eea7f0f8 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.619344:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789023660.620033:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:10475:x1875927007009280:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1211us (2608us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1789023660.620058:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00010000:00010000:1.0:1789023660.621230:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.621243:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.621251:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.621257:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023660.621261:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.621268:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.621283:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:1.0:1789023660.621286:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789023660.621299:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.621306:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34181a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023660.622352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.622818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007009408 00000100:00100000:1.0:1789023660.622829:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007009408 00000100:00100000:1.0:1789023660.622887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:1.0:1789023660.622898:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:10475:x1875927007009408:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023660.622920:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023660.622939:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9ee expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.622995:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.623009:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.623026:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:1.0:1789023660.623029:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023660.623033:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023660.623081:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:10475:x1875927007009408:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 185us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023660.623088:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:0.0:1789023660.625947:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.626866:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007009536 00000100:00100000:2.0:1789023660.626876:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007009536 00000100:00100000:2.0:1789023660.626961:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:2.0:1789023660.626971:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875927007009536:12345-192.168.203.48@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789023660.627000:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp t0 exp 0000000000000000 cur 326 last 0 00000020:00000080:2.0:1789023660.627032:0:6695:0:(genops.c:1384:class_connect()) connect: client fa0f4aba-40ac-42f8-b5d5-b35db811ced7, cookie 0xc3c1fcbfb34181b3 00002000:00100000:2.0:1789023660.627044:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fa0f4aba-40ac-42f8-b5d5-b35db811ced7/ffff8e65ffdb3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789023660.627054:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789023660.627269:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789023660.627299:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8e65ffdb7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023660.627367:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2360:x1875927007009536:12345-192.168.203.48@tcp:8:lhsmtool_posix.0 Request processed in 396us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.627375:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789023660.639692:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023660.639832:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007009664 00000100:00100000:3.0:1789023660.639842:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007009664 00000100:00100000:3.0:1789023660.639911:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:3.0:1789023660.639921:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:0:x1875927007009664:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789023660.643034:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789023660.699118:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000001:00080000:1.0:1789023660.699135:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1789023660.701862:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:0:x1875927007009664:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 61932us (62177us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789023660.701885:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:1.0:1789023660.713948:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.714470:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007009920 00000100:00100000:2.0:1789023660.714504:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007009920 00000100:00100000:3.0:1789023660.714619:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789023660.714631:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:10475:x1875927007009920:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789023660.714992:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:10475:x1875927007009920:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 362us (1053us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789023660.715001:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789023660.721757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.721838:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007010176 00000100:00100000:2.0:1789023660.721848:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007010176 00000100:00100000:2.0:1789023660.721902:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:2.0:1789023660.721913:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:10475:x1875927007010176:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789023660.722021:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:10475:x1875927007010176:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 110us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.722029:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:2.0:1789023660.725782:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.725887:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007010304 00000100:00100000:1.0:1789023660.725897:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007010304 00000100:00100000:1.0:1789023660.725956:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:1.0:1789023660.725966:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:10475:x1875927007010304:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023660.725986:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023660.726006:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34181ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9f5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.726079:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34181c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.726093:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34181c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.726104:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34181c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023660.726139:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023660.726169:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34181c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.726195:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34181ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9f5 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.726211:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34181c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9f5 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.726218:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:1.0:1789023660.726221:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789023660.726225:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fc00, rc 0) 00000100:00100000:1.0:1789023660.726924:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10475:x1875927007010304:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 959us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023660.726933:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:1.0:1789023660.752171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.752265:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007010432 00000100:00100000:0.0:1789023660.752275:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007010432 00000100:00100000:0.0:1789023660.752331:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:0.0:1789023660.752342:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2364:x1875927007010432:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023660.752368:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023660.752389:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bf9fc expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023660.752417:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa255ac, blocks: 0x1 00010000:00010000:0.0:1789023660.752434:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1789023660.752438:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023660.752446:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.752465:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 6 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.752508:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05800, rc 0) 00000100:00100000:0.0:1789023660.752575:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2364:x1875927007010432:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 234us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023660.752581:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1789023660.771334:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.771423:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007010688 00000100:00100000:0.0:1789023660.771433:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007010688 00000100:00100000:0.0:1789023660.771511:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:0.0:1789023660.771521:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10475:x1875927007010688:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789023660.771635:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10475:x1875927007010688:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 115us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023660.771643:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:1.0:1789023660.781307:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023660.781430:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007010816 00000100:00100000:3.0:1789023660.781441:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007010816 00000100:00100000:3.0:1789023660.781537:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1789023660.781548:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:10475:x1875927007010816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023660.781565:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023660.781582:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa03 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.781609:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.781626:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023660.781630:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023660.781636:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.781667:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 7 pid: 6696 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.781681:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 7 pid: 6696 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023660.781695:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7317b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875927024858880:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023660.781770:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a900 going to sleep for 11 seconds 00000100:00100000:0.0:1789023660.783858:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7317b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6694:1875927024858880:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023660.783890:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.783909:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d600, rc 0) 00000100:00100000:0.0:1789023660.783960:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:10475:x1875927007010816:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 2413us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023660.783968:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1789023660.787012:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.787080:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007010944 00000100:00100000:0.0:1789023660.787089:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007010944 00010000:00010000:0.0:1789023660.787122:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 7 pid: 6696 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.787158:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:0.0:1789023660.787166:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d7258850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007010944:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023660.787179:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023660.787199:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 7 pid: 6696 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.787227:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 7 pid: 6696 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.787248:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000894e0706/0xc3c1fcbfb34181c8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9fc expref: 7 pid: 6696 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.787263:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023660.787267:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023660.787275:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.787285:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.787319:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.787332:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1875927024859008:192.168.203.48@tcp:105: 00000100:00100000:0.0:1789023660.787411:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c7ec6840 going to sleep for 11 seconds 00000100:00100000:1.0:1789023660.797952:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.798047:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1875927024859008:192.168.203.48@tcp:105: 00010000:00010000:2.0:1789023660.798068:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023660.798120:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d7258850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007010944:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 10953us (11115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023660.798130:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:2.0:1789023660.801323:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007011072 00000100:00100000:2.0:1789023660.801338:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007011072 00002000:00100000:2.0:1789023660.801394:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e65e70b3b80 x1875927007011072/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:586/0 lens 504/0 e 0 to 0 dl 1789023671 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789023660.801405:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65e70b3b80 with x1875927007011072 ext(0->8) 00002000:00010000:2.0:1789023660.801411:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65e70b3b80 00000100:00100000:2.0:1789023660.801444:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1789023660.801452:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007011072:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789023660.802080:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007011072:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 625us (4133us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789023660.802088:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00002000:00100000:2.0:1789023660.802095:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e65e70b3b80 x1875927007011072/t4294967302(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:586/0 lens 504/448 e 0 to 0 dl 1789023671 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789023660.802104:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65e70b3b80 with x1875927007011072 ext(0->8) 00002000:00010000:2.0:1789023660.802108:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65e70b3b80 00000100:00100000:1.0:1789023660.815418:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023660.815582:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007011200 00000100:00100000:3.0:1789023660.815592:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007011200 00000100:00100000:3.0:1789023660.815641:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:3.0:1789023660.815651:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10475:x1875927007011200:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789023660.877107:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10475:x1875927007011200:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 61448us (61689us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023660.877120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000001:00080000:1.0:1789023660.877209:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1789023660.877217:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:1.0:1789023660.877282:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789023660.877297:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e65d72c1000 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789023660.877301:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65d00c1a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e65d72c1a80 00000020:00080000:1.0:1789023660.877304:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65d00c1200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65f6f04800 00000001:00080000:1.0:1789023660.877319:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000020:00080000:1.0:1789023660.877564:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1789023660.877671:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789023660.877688:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024859136:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789023660.877736:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023660.877811:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024859136 00000100:00100000:1.0:1789023660.877819:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024859136 00000100:00100000:1.0:1789023660.877874:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789023660.877884:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1875927024859136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789023660.877908:0:6696:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1789023660.877942:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa255aa, atime: 0x6aa255aa, ctime: 0x6aa255aa, blocks: 0x1 00010000:00010000:1.0:1789023660.877951:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.877982:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:1.0:1789023660.877987:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023660.877994:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878010:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878021:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878029:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878045:0:6696:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789023660.878494:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875927024859136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 591us (737us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789023660.878502:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1789023660.878523:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789023660.878535:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023660.878540:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878548:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023660.878552:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878572:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878588:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878597:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34181d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.878614:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023660.878616:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023660.878618:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789023660.878937:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65c84c1f80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789023660.878945:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024859136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789023660.879758:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023660.879775:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024859264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789023660.879841:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023660.880552:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024859264 00000100:00100000:0.0:1789023660.880561:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024859264 00000100:00100000:0.0:1789023660.880734:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023660.880746:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024859264:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789023660.880913:0:7164:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789023660.880917:0:7164:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789023660 00002000:00010000:0.0:1789023660.880919:0:7164:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789023660.880921:0:7164:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789023660 -> 1789023660 00002000:00010000:0.0:1789023660.880923:0:7164:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789023660.880977:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875927024859264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 233us (1136us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789023660.880984:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1789023660.881859:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65df3d6a00/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789023660.881869:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024859264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789023660.884234:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.884527:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007011328 00000100:00100000:1.0:1789023660.884546:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007011328 00000100:00100000:1.0:1789023660.884602:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789023660.884614:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2363:x1875927007011328:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789023660.938702:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2363:x1875927007011328:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 54080us (54465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023660.938716:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000001:00080000:1.0:1789023660.938752:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789023660.938764:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1789023660.943252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.943429:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007011584 00000100:00100000:0.0:1789023660.943440:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007011584 00000100:00100000:0.0:1789023660.943854:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:0.0:1789023660.943865:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:10475:x1875927007011584:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789023660.943913:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023660.943939:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34181c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9f5 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.943956:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:0.0:1789023660.943961:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023660.943990:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.944004:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.944014:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789023660.944257:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e51fa8d reply state 000000005ceb9dc0 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.944266:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789023660.944382:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:10475:x1875927007011584:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 519us (1137us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789023660.944389:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00010000:00010000:3.0:1789023660.948209:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.948246:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.948255:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.948261:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023660.948266:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.948274:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.948290:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:3.0:1789023660.948293:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023660.948299:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.948314:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34181dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023660.949744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.949947:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007011712 00000100:00100000:0.0:1789023660.949956:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007011712 00000100:00100000:0.0:1789023660.950013:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:0.0:1789023660.950023:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007011712:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789023660.950268:0:7164:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789023660.950272:0:7164:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789023660 -> 1789023659 00002000:00010000:0.0:1789023660.950275:0:7164:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789023658 00002000:00010000:0.0:1789023660.950277:0:7164:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789023660 -> 1789023659 00002000:00010000:0.0:1789023660.950279:0:7164:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789023660.950606:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007011712:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 582us (867us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789023660.950615:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:1.0:1789023660.954018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023660.954727:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007011968 00000100:00100000:3.0:1789023660.954738:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007011968 00000100:00100000:3.0:1789023660.954807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:3.0:1789023660.954818:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:10475:x1875927007011968:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789023660.954886:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.955020:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.955046:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.955080:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.955093:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 13 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023660.955106:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7316d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024859392:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023660.955208:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023660.964897:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7316d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024859392:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023660.964927:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023660.965966:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.966367:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007012096 00000100:00100000:0.0:1789023660.966382:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007012096 00010000:00010000:0.0:1789023660.966421:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.966459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1789023660.966469:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:2362:x1875927007012096:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023660.966525:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023660.966533:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.966545:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.966567:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341819e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9e7 expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.966584:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:0.0:1789023660.966589:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.966604:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.966614:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.966639:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023660.967163:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:2362:x1875927007012096:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 693us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023660.967172:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00010000:00010000:3.0:1789023660.967318:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967328:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967354:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967361:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967367:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967381:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023660.967386:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967393:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967404:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:3.0:1789023660.967407:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789023660.967411:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.967416:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34181e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.967982:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:10475:x1875927007011968:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 13164us (13969us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789023660.967993:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:1.0:1789023660.985289:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023660.985679:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007012224 00000100:00100000:2.0:1789023660.985689:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007012224 00000100:00100000:2.0:1789023660.985748:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:2.0:1789023660.985758:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007012224:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789023660.985810:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.985830:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.985838:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789023660.985843:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023660.985847:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.985894:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023660.985908:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 7 pid: 6694 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023660.985921:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875927024859520:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023660.986007:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f40b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023660.991855:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023660.991957:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007012352 00000100:00100000:0.0:1789023660.991974:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007012352 00010000:00010000:0.0:1789023660.992014:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 8 pid: 6694 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.992059:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1789023660.992069:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007012352:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023660.992083:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023660.992104:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 8 pid: 6694 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.992116:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 8 pid: 6694 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.992146:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023660.992151:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023660.992157:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992165:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fca973de/0xc3c1fcbfb34181cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa03 expref: 8 pid: 6694 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.992168:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023660.992192:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023660.992201:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6695:1875927024859520:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023660.992224:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.992239:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007012352:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 170us (391us total) trans 0 rc 0/0 00010000:00010000:3.0:1789023660.992246:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023660.992257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00010000:00010000:3.0:1789023660.992261:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992298:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992310:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992318:0:6695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992324:0:6695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023660.992329:0:6695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992337:0:6695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992350:0:6695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023660.992358:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7349c72/0xc3c1fcbfb34181eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023660.992418:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007012224:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 6661us (7139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023660.992426:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1789023660.998344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023660.998512:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007012608 00000100:00100000:1.0:1789023660.998522:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007012608 00000100:00100000:1.0:1789023660.998578:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:1.0:1789023660.998589:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:10475:x1875927007012608:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789023660.998673:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.998691:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.998704:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.998913:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.998925:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.998934:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.998966:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023660.998979:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 13 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023660.998992:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024859648:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023660.999091:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023661.006677:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023661.006775:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024859648:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023661.006811:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.006940:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007012736 00000100:00100000:3.0:1789023661.006948:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007012736 00010000:00010000:3.0:1789023661.006981:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.007098:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1789023661.007110:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:2361:x1875927007012736:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023661.007125:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023661.007132:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.007143:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.007163:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34181ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9ee expref: 14 pid: 5847 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.007177:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:3.0:1789023661.007182:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.007191:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.007197:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.007396:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023661.007466:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:2361:x1875927007012736:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 357us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023661.007473:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00010000:00010000:1.0:1789023661.010042:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.010060:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789023661.010319:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789023661.010466:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1789023661.011630:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789023661.012095:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024859776:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789023661.012161:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023661.012315:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023661.012409:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024859776 00000100:00100000:3.0:1789023661.012417:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024859776 00000100:00100000:3.0:1789023661.012533:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789023661.012555:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875927024859776:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789023661.012649:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875927024859776:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023661.012657:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023661.012673:0:5845:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789023661.012692:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65df3d6a00, transno 4294967303 00000100:00100000:0.0:1789023661.012717:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024859776:0@lo:1000:mdt00_000.0 00000100:00080000:1.0:1789023661.013133:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789023661.013274:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789023661.013407:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024859904:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789023661.013455:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023661.013498:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c7ec63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023661.013517:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024859904 00000100:00100000:0.0:1789023661.013522:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024859904 00000100:00100000:0.0:1789023661.013564:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023661.013573:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875927024859904:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789023661.013746:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875927024859904:12345-0@lo:1000:mdt00_000.0 Request processed in 175us (290us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789023661.013753:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023661.013789:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024859904:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789023661.013835:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.013845:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.013852:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.013858:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023661.013862:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.013869:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016657:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960500) 00010000:00010000:0.0:1789023661.016661:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789023661.016669:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016677:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34181f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016725:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016732:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016738:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016743:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023661.016747:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016753:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016760:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:0.0:1789023661.016763:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789023661.016766:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016771:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418127 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016825:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016839:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 16 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016847:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016884:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 16 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.016898:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 16 pid: 7654 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023661.016912:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024860032:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023661.016999:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023661.025452:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023661.025503:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007012864 00000100:00100000:0.0:1789023661.025510:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007012864 00010000:00010000:0.0:1789023661.025543:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 17 pid: 7654 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023661.025575:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1789023661.025584:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:2361:x1875927007012864:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023661.025596:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023661.025602:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 17 pid: 7654 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.025620:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 17 pid: 7654 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.025641:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:0.0:1789023661.025646:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.025656:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.025663:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.025680:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023661.025722:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:2361:x1875927007012864:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 139us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023661.025729:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00010000:00010000:3.0:1789023661.026393:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418143 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf9d2 expref: 16 pid: 7654 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.026409:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024860032:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023661.026445:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026454:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026460:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026471:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026496:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026504:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026518:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023661.026523:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026531:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026542:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:3.0:1789023661.026545:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023661.026549:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026556:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418200 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026567:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026573:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026578:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026583:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023661.026586:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026591:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026610:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1f00) 00010000:00010000:3.0:1789023661.026612:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789023661.026616:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.026621:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb34181f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.026856:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:10475:x1875927007012608:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 28267us (28518us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1789023661.026865:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000020:00080000:3.0:1789023661.026870:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789023661.027926:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023661.027933:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789023661.027959:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789023661.027965:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789023661.029874:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023661.029939:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007013120 00000100:00100000:3.0:1789023661.029949:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007013120 00000100:00100000:3.0:1789023661.029999:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:3.0:1789023661.030009:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:10475:x1875927007013120:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789023661.030685:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789023661.031004:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:3.0:1789023661.031051:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.031066:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.031078:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.031086:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.031103:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.031110:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.031165:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789023661.031258:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:10475:x1875927007013120:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1249us (1390us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789023661.031266:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000020:00080000:3.0:1789023661.031272:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789023661.031694:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023661.031702:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.031709:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023661.031713:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.031721:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.031734:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e65c6960800) 00010000:00010000:2.0:1789023661.031737:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789023661.031741:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.031747:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418207 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.031771:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023661.031773:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023661.031775:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023661.065838:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024860160:0@lo:400:kworker.0 00000100:00100000:1.0:1789023661.065905:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023661.066866:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024860416:0@lo:400:kworker.0 00000100:00100000:3.0:1789023661.066908:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023661.066937:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789023661.066944:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024860288:0@lo:400:kworker.0 00000100:00100000:3.0:1789023661.066966:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023661.066994:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024860544:0@lo:400:kworker.0 00000100:00100000:3.0:1789023661.067016:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023661.069529:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024860160 00000100:00100000:1.0:1789023661.069544:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024860160 00000100:00100000:1.0:1789023661.069602:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789023661.069612:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024860160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023661.069698:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3311:x1875927024860160:12345-0@lo:400:kworker.0 Request processed in 87us (3793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023661.069705:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1789023661.069755:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72bd38e6-1e7e-4158-85a3-542824dd2807:3311:1875927024860160:0@lo:400:kworker.0 00000100:00100000:1.0:1789023661.071101:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024860672:0@lo:400:kworker.0 00000100:00100000:0.0:1789023661.071129:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024860416 00000100:00100000:0.0:1789023661.071138:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024860416 00000100:00100000:1.0:1789023661.071160:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789023661.071199:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023661.071210:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024860672 00000100:00100000:1.0:1789023661.071215:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024860672 00000100:00100000:1.0:1789023661.071259:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789023661.071268:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024860672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023661.071316:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024860288 00000100:00100000:1.0:1789023661.071322:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024860672:12345-0@lo:400:kworker.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023661.071323:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024860288 00000100:00100000:1.0:1789023661.071332:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789023661.071345:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024860544 00000100:00100000:0.0:1789023661.071349:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024860544 00000100:00100000:0.0:1789023661.071377:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789023661.071379:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024860672:0@lo:400:kworker.0 00000100:00100000:0.0:1789023661.071388:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024860416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023661.071449:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024860416:12345-0@lo:400:kworker.0 Request processed in 64us (4540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023661.071456:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789023661.071470:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789023661.071497:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024860288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023661.071526:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024860288:12345-0@lo:400:kworker.0 Request processed in 50us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023661.071531:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789023661.071544:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789023661.071549:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024860544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023661.071698:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024860288:0@lo:400:kworker.0 00000100:00100000:1.0:1789023661.071710:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024860416:0@lo:400:kworker.0 00000100:00100000:0.0:1789023661.071761:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875927024860544:12345-0@lo:400:kworker.0 Request processed in 211us (4743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023661.071767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:0.0:1789023661.071800:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023661.071821:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1875927024860544:0@lo:400:kworker.0 00000040:00080000:2.0:1789023661.136714:0:12014:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023661.136724:0:12014:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023661.136759:0:12014:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789023661.136766:0:12014:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789023661.326565:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023661.341508:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023661.341549:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007013376 00000100:00100000:1.0:1789023661.341559:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007013376 00000100:00100000:1.0:1789023661.341609:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1789023661.341619:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:10489:x1875927007013376:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023661.341642:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023661.341661:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341820e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa0a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.341749:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3418215 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.341764:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3418215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.341782:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3418215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023661.341808:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1789023661.341931:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341820e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa0a expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.341946:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3418215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa0a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.341955:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:1.0:1789023661.341958:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789023661.341961:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e800, rc 0) 00000100:00100000:1.0:1789023661.342024:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:10489:x1875927007013376:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 406us (521us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789023661.342031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:0.0:1789023661.357005:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023661.357091:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007013504 00000100:00100000:2.0:1789023661.357100:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007013504 00000100:00100000:2.0:1789023661.357160:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:2.0:1789023661.357171:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:10489:x1875927007013504:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:2.0:1789023661.357245:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357262:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357274:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357290:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357298:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357313:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357575:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357591:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357599:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023661.357639:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357651:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357658:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357664:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357670:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023661.357687:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357695:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357706:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023661.357710:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023661.357713:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357719:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357738:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357743:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357748:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357753:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023661.357756:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357762:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357769:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1a00) 00010000:00010000:2.0:1789023661.357771:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023661.357774:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357779:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341822a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357805:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357812:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357826:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357837:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023661.357840:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357846:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357854:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023661.357857:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023661.357859:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.357865:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418231 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023661.357940:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:10489:x1875927007013504:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 770us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023661.357949:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:2.0:1789023661.455435:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023661.455569:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007013760 00000100:00100000:1.0:1789023661.455579:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007013760 00000100:00100000:1.0:1789023661.455642:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:1.0:1789023661.455654:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:10500:x1875927007013760:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023661.455675:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023661.455693:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3418238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa11 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.455760:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.455787:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.455825:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.455841:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.455849:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.455857:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456110:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456120:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456127:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023661.456135:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789023661.456230:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456239:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456247:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456260:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023661.456265:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456273:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456285:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:1.0:1789023661.456288:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023661.456294:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456299:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb341823f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456309:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456315:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456322:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456327:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023661.456330:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456336:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456354:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65eea05700) 00010000:00010000:1.0:1789023661.456357:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023661.456360:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456366:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456413:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3418238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456428:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.456435:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:1.0:1789023661.456437:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023661.456439:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fe00, rc 0) 00000100:00100000:1.0:1789023661.456527:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:10500:x1875927007013760:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 875us (1098us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789023661.456534:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:2.0:1789023661.477632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023661.477705:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007013888 00000100:00100000:3.0:1789023661.477716:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007013888 00000100:00100000:3.0:1789023661.477776:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:3.0:1789023661.477785:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:10500:x1875927007013888:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1789023661.477856:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477872:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477891:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477916:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477923:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477930:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477936:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023661.477940:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477947:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477957:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:3.0:1789023661.477959:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789023661.477964:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.477986:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341825b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.478067:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:10500:x1875927007013888:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 283us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023661.478074:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:2.0:1789023661.481749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023661.484276:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007014144 00000100:00100000:1.0:1789023661.484290:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007014144 00000100:00100000:1.0:1789023661.484360:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789023661.484372:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:10500:x1875927007014144:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023661.484631:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9af8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:10500:x1875927007014144:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 260us (2889us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789023661.484640:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:2.0:1789023661.572587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023661.572697:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007014400 00000100:00100000:1.0:1789023661.572707:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007014400 00000100:00100000:1.0:1789023661.572770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:1.0:1789023661.572781:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:10018:x1875927007014400:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023661.572824:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023661.572847:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3418262 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa18 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.572948:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.572962:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.572971:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.573015:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.573029:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 23 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023661.573042:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024860800:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023661.573137:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023661.577994:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789023661.578028:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024860928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023661.578096:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023661.578343:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024860928 00000100:00100000:0.0:1789023661.578351:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024860928 00000100:00100000:0.0:1789023661.578405:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789023661.578415:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875927024860928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023661.578448:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023661.578530:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2669500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875927024860928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023661.578538:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789023661.580388:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024860928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023661.581135:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023661.581220:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007014528 00000100:00100000:3.0:1789023661.581238:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007014528 00010000:00010000:3.0:1789023661.581273:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 24 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023661.581673:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024860800:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023661.581693:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.581734:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789023661.581757:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:2362:x1875927007014528:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023661.581773:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023661.581779:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 24 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.581803:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 24 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.581825:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb341824d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa11 expref: 24 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.581841:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:3.0:1789023661.581846:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.581855:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.581862:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.581891:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023661.581925:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.581935:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.581948:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:2362:x1875927007014528:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 203us (815us total) trans 0 rc 0/0 00000004:00200000:1.0:1789023661.581953:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1789023661.581967:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00010000:00010000:1.0:1789023661.582618:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3418262 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.582635:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.582643:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:1.0:1789023661.582646:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789023661.582649:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023661.583013:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:10018:x1875927007014400:12345-192.168.203.48@tcp:101:bash.0 Request processed in 10224us (10425us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789023661.583022:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:2.0:1789023661.585574:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023661.585877:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007014784 00000100:00100000:0.0:1789023661.585887:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007014784 00000100:00100000:0.0:1789023661.585942:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:0.0:1789023661.585951:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:10018:x1875927007014784:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1789023661.586266:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.586282:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.586293:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789023661.586334:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:0.0:1789023661.586354:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001f46fdb6 reply state 00000000dd0bb5c5 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023661.586363:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789023661.586622:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:0.0:1789023661.587070:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:10018:x1875927007014784:12345-192.168.203.48@tcp:36:bash.0 Request processed in 1117us (1502us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789023661.587078:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000020:00080000:0.0:1789023661.587084:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1789023661.590402:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.590419:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023661.590428:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1789023661.590433:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.590441:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023661.590461:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.590470:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.590518:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:1.0:1789023661.590521:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023661.590526:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.590533:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418277 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023661.591299:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007014912 00000100:00100000:2.0:1789023661.591320:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007014912 00000100:00100000:2.0:1789023661.591391:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:2.0:1789023661.591403:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:10018:x1875927007014912:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023661.591426:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023661.591444:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341827e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa1f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.591525:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341827e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa1f expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.591539:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341827e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa1f expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023661.591557:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:2.0:1789023661.591560:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023661.591563:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06600, rc 0) 00000100:00100000:2.0:1789023661.591625:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:10018:x1875927007014912:12345-192.168.203.48@tcp:101:bash.0 Request processed in 224us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023661.591632:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:2.0:1789023661.594937:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023661.596083:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007015040 00000100:00100000:1.0:1789023661.596096:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007015040 00000100:00100000:1.0:1789023661.596164:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1789023661.596175:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:10018:x1875927007015040:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023661.596193:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023661.596212:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa26 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789023661.596238:0:6696:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa255ab, atime: 0x6aa255aa, ctime: 0x6aa255ab, blocks: 0xb 00010000:00010000:1.0:1789023661.596260:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=327s v=(0 0) 00010000:00010000:1.0:1789023661.596265:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023661.596272:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.596287:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023661.596313:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707ec00, rc 0) 00000100:00100000:1.0:1789023661.596366:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:10018:x1875927007015040:12345-192.168.203.48@tcp:101:bash.0 Request processed in 193us (1437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023661.596374:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:1.0:1789023661.601644:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023661.601877:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007015168 00000100:00100000:0.0:1789023661.601887:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007015168 00002000:00010000:0.0:1789023661.601930:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789023661.601935:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f6c5a680 with x1875927007015168 ext(0->18446744073709551615) 00002000:00010000:0.0:1789023661.601946:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f6c5a680. 00000100:00100000:0.0:1789023661.602043:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:0.0:1789023661.602068:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007015168:12345-192.168.203.48@tcp:10:bash.0 00002000:00010000:0.0:1789023661.602364:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789023661.602368:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789023659 -> 1789023661 00002000:00010000:0.0:1789023661.602370:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789023658 -> 1789023658 00002000:00010000:0.0:1789023661.602373:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789023659 -> 1789023661 00002000:00010000:0.0:1789023661.602375:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789023661.602450:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007015168:12345-192.168.203.48@tcp:10:bash.0 Request processed in 384us (814us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789023661.602458:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00010000:0.0:1789023661.602462:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789023661.602465:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f6c5a680 with x1875927007015168 ext(0->18446744073709551615) 00002000:00010000:0.0:1789023661.602470:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f6c5a680. 00000100:00100000:0.0:1789023661.722759:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023661.722985:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007015296 00000100:00100000:3.0:1789023661.722995:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007015296 00000100:00100000:3.0:1789023661.723056:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:3.0:1789023661.723066:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:10515:x1875927007015296:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:3.0:1789023661.723137:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723153:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723163:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723176:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723183:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723189:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723655:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723665:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723673:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789023661.723734:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723747:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723753:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723759:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723765:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023661.723769:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723776:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723798:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:3.0:1789023661.723801:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023661.723807:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723813:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341828c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723824:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.723829:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724042:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724047:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023661.724050:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724056:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724065:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c6960400) 00010000:00010000:3.0:1789023661.724068:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023661.724071:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724077:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724093:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724099:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724104:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724108:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023661.724111:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724127:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724134:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:3.0:1789023661.724137:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023661.724140:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.724146:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb341829a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.724233:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:10515:x1875927007015296:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 1167us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023661.724242:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:1.0:1789023661.799018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023661.799134:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007015552 00000100:00100000:0.0:1789023661.799143:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007015552 00000100:00100000:0.0:1789023661.799245:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:0.0:1789023661.799255:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:10518:x1875927007015552:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023661.799275:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023661.799294:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb34182a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa2d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799427:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799441:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799469:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799510:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799518:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799525:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799931:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34182b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799941:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34182b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.799948:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34182b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023661.799958:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789023661.800041:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800049:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800056:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800061:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023661.800072:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800080:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800091:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023661.800095:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023661.800099:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800106:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34182a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800119:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800125:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800131:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800137:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023661.800140:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800145:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800152:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c8ebd600) 00010000:00010000:0.0:1789023661.800154:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023661.800161:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800167:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34182af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800206:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb34182a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa2d expref: 30 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800220:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34182b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa2d expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.800228:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:0.0:1789023661.800230:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789023661.800232:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04400, rc 0) 00000100:00100000:0.0:1789023661.800355:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:10518:x1875927007015552:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1102us (1345us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789023661.800362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:1.0:1789023661.806126:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023661.806224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007015680 00000100:00100000:0.0:1789023661.806235:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007015680 00000100:00100000:0.0:1789023661.806334:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:0.0:1789023661.806354:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:10518:x1875927007015680:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1789023661.806433:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.806451:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.806460:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.806551:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.806565:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 29 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023661.806580:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024861056:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023661.807217:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023661.812320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023661.812543:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007015936 00000100:00100000:2.0:1789023661.812554:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007015936 00000100:00100000:2.0:1789023661.812630:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:2.0:1789023661.812642:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:5600:x1875927007015936:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789023661.812996:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:5600:x1875927007015936:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 355us (686us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789023661.813003:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:1.0:1789023661.817587:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023661.817821:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007016064 00000100:00100000:3.0:1789023661.817832:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007016064 00010000:00010000:3.0:1789023661.817873:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 31 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023661.817910:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:3.0:1789023661.817918:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:2361:x1875927007016064:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023661.817933:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023661.817939:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 31 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.817951:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 31 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.817989:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:3.0:1789023661.817995:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.818004:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.818012:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023661.818030:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023661.818074:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:2361:x1875927007016064:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 156us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023661.818080:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00010000:00010000:0.0:1789023661.822229:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418269 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa18 expref: 30 pid: 5846 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023661.822257:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024861056:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023661.822282:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822293:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822299:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822331:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822338:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822346:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822368:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023661.822372:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822379:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822395:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:0.0:1789023661.822398:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789023661.822403:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023661.822408:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34182c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023661.822513:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:10518:x1875927007015680:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 16137us (16361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023661.822522:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:1.0:1789023661.845081:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023661.845159:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007016320 00000100:00100000:2.0:1789023661.845169:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007016320 00000100:00100000:2.0:1789023661.845224:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789023661.845235:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:10518:x1875927007016320:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023661.845914:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:10518:x1875927007016320:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 678us (840us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789023661.845924:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1789023662.049095:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023662.049183:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007016576 00000100:00100000:2.0:1789023662.049194:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007016576 00000100:00100000:2.0:1789023662.049273:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:2.0:1789023662.049283:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:10529:x1875927007016576:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789023662.049305:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023662.049324:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb34182cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa34 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049405:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049420:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049432:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049447:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049454:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049509:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049780:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34182e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049798:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34182e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049807:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34182e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023662.049817:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789023662.049906:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049914:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049920:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049926:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.049931:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049938:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049949:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023662.049952:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.049964:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049970:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb34182d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049981:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049987:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049992:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.049997:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.049999:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.050004:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.050011:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1000) 00010000:00010000:2.0:1789023662.050013:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.050016:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.050020:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34182d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.050064:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb34182cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa34 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.050090:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34182e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa34 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.050098:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:2.0:1789023662.050100:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023662.050103:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06a00, rc 0) 00000100:00100000:2.0:1789023662.050168:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:10529:x1875927007016576:12345-192.168.203.48@tcp:101:cat.0 Request processed in 886us (1092us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1789023662.050176:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00080000:0.0:1789023662.050472:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023662.061233:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.061823:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007016832 00000100:00100000:3.0:1789023662.061835:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007016832 00000100:00100000:3.0:1789023662.061896:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:3.0:1789023662.061907:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:10529:x1875927007016832:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:3.0:1789023662.062147:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+33:10529:x1875927007016832:12345-192.168.203.48@tcp:35:cat.0 Request processed in 241us (924us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789023662.062154:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000040:00080000:2.0:1789023662.095537:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023662.095546:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023662.095588:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789023662.095596:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789023662.096403:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.096527:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007017088 00000100:00100000:3.0:1789023662.096538:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007017088 00000100:00100000:3.0:1789023662.096605:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:3.0:1789023662.096616:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+33:10530:x1875927007017088:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:3.0:1789023662.096682:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789023662.096946:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34182e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa34 expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.096967:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34182b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa2d expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.096980:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341827e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa1f expref: 31 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.096990:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65eea05200) 00010000:00010000:3.0:1789023662.097000:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023662.097020:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097035:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097044:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097058:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097065:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097070:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097286:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097303:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.097310:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023662.098377:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789023662.098388:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328168909899ns, next at 329168907217ns, rc = 0 00010000:00010000:2.0:1789023662.099156:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099173:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099184:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099192:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099198:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099216:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099236:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023662.099259:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099266:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099271:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099277:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.099281:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099288:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099299:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65c6960600) 00010000:00010000:2.0:1789023662.099302:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789023662.099306:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099312:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34182fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099330:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.099336:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.099454:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023662.099460:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.099466:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023662.099470:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.099807:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.099819:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e65c6960600) 00010000:00010000:3.0:1789023662.099822:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789023662.099825:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.099831:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418303 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.099849:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023662.099850:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023662.099852:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023662.100815:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.100821:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.100826:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.100833:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.100845:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023662.100847:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.100851:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.100858:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34182ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023662.100873:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3d293b3 reply state 00000000328a869e transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023662.100882:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023662.100974:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:10530:x1875927007017088:12345-192.168.203.48@tcp:36:rm.0 Request processed in 4357us (4574us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789023662.100983:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 95 00010000:00010000:3.0:1789023662.106439:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.106474:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.106537:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.106543:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023662.106547:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.106555:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.106581:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65c6960400) 00010000:00010000:3.0:1789023662.106584:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023662.106589:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.106596:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb34182f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.182895:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023662.183324:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007017344 00000100:00100000:2.0:1789023662.183334:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007017344 00000100:00100000:2.0:1789023662.183899:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:2.0:1789023662.183913:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:10536:x1875927007017344:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023662.183955:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023662.183976:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341830a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa3b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.184086:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.184101:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.184113:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.184128:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.184135:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.184142:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023662.184917:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1789023662.185086:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185098:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185107:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185153:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185161:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185168:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185174:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.185178:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185186:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185197:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023662.185200:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.185205:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185212:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418311 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023662.185224:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000006be6b03 reply state 0000000083129c1c transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023662.185232:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789023662.185260:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341830a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185287:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 33 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.185294:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:2.0:1789023662.185297:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023662.185299:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06600, rc 0) 00000100:00100000:2.0:1789023662.185575:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:10536:x1875927007017344:12345-192.168.203.48@tcp:101:bash.0 Request processed in 1664us (2688us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789023662.185584:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 96 00010000:00010000:1.0:1789023662.191915:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.191933:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.191940:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.191946:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023662.191951:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.191975:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.191991:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1000) 00010000:00010000:1.0:1789023662.191994:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023662.191999:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.192007:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418318 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.195654:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.195901:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007017472 00000100:00100000:3.0:1789023662.195911:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007017472 00000100:00100000:3.0:1789023662.196051:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1789023662.196062:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007017472:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789023662.196080:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023662.196101:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa42 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789023662.196156:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789023662.196174:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1789023662.196178:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023662.196573:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.196597:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.196610:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713ce00, rc 0) 00000100:00100000:3.0:1789023662.196673:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007017472:12345-192.168.203.48@tcp:101:bash.0 Request processed in 613us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023662.196680:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00080000:0.0:1789023662.201849:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023662.202949:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023662.203050:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007017600 00000100:00100000:1.0:1789023662.203060:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007017600 00000100:00100000:1.0:1789023662.203166:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:1.0:1789023662.203176:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:10536:x1875927007017600:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023662.203270:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023662.203290:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa49 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.203322:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.203332:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023662.203337:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023662.203352:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.203409:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 9 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.203423:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 9 pid: 6694 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.203439:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875927024861184:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023662.203554:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023662.207162:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.207287:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007017728 00000100:00100000:3.0:1789023662.207295:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007017728 00010000:00010000:3.0:1789023662.207330:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 10 pid: 6694 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.207375:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1789023662.207385:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2361:x1875927007017728:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023662.207400:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023662.207421:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 10 pid: 6694 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.207455:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 10 pid: 6694 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.207499:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023662.207504:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023662.207512:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.207521:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.207556:0:6710:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.207569:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7314e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6710:1875927024861312:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789023662.207662:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023662.210745:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7314e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6710:1875927024861312:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789023662.210772:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023662.210844:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2361:x1875927007017728:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 3460us (3690us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023662.210855:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00010000:00010000:1.0:1789023662.212948:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d403d384/0xc3c1fcbfb341832d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa42 expref: 9 pid: 6694 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.212971:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875927024861184:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023662.213000:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.213015:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023662.213078:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:10536:x1875927007017600:12345-192.168.203.48@tcp:101:bash.0 Request processed in 9903us (10135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023662.213086:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:2.0:1789023662.216905:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.216978:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007017984 00000100:00100000:3.0:1789023662.216988:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007017984 00000100:00100000:3.0:1789023662.217034:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:3.0:1789023662.217054:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+33:10536:x1875927007017984:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:3.0:1789023662.217378:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:10536:x1875927007017984:12345-192.168.203.48@tcp:35:bash.0 Request processed in 324us (481us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789023662.217386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00010000:00010000:1.0:1789023662.350708:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023662.500805:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.501009:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007018112 00000100:00100000:0.0:1789023662.501020:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007018112 00000100:00100000:0.0:1789023662.501079:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:0.0:1789023662.501089:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:10552:x1875927007018112:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023662.501112:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023662.501131:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341833b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa50 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.501227:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.501242:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.501252:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023662.501284:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789023662.501287:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023662.501303:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.501327:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb341833b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa50 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.501346:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa50 expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.501354:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023662.501356:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023662.501360:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05400, rc 0) 00000100:00100000:0.0:1789023662.502908:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:10552:x1875927007018112:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1810us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.502920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:2.0:1789023662.507365:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023662.507551:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007018368 00000100:00100000:1.0:1789023662.507561:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007018368 00000100:00100000:1.0:1789023662.507620:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:1.0:1789023662.507631:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:10552:x1875927007018368:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023662.507665:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023662.507684:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3418349 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa57 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.507793:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3418350 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.507808:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3418350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.507820:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3418350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023662.507836:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789023662.507956:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb3418349 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa57 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.507973:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3418350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa57 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.507980:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:1.0:1789023662.507983:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023662.507987:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e200, rc 0) 00000100:00100000:1.0:1789023662.508046:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:10552:x1875927007018368:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 417us (691us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789023662.508053:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:2.0:1789023662.517981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023662.518020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.519648:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007018624 00000100:00100000:3.0:1789023662.519661:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007018624 00000100:00100000:3.0:1789023662.519737:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:3.0:1789023662.519748:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:10552:x1875927007018624:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023662.519774:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023662.519804:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb341835e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa5e expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.519903:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418365 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.519919:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.519930:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418365 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023662.519941:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789023662.520055:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb341835e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa5e expref: 40 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.520074:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa5e expref: 39 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.520101:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:3.0:1789023662.520104:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789023662.520107:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c200, rc 0) 00000100:00100000:3.0:1789023662.520179:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+39:10552:x1875927007018624:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 433us (2205us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789023662.520196:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:0.0:1789023662.522459:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007018752 00000100:00100000:0.0:1789023662.522473:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007018752 00000100:00100000:0.0:1789023662.522575:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1789023662.522589:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+39:2362:x1875927007018752:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023662.522603:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023662.522628:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb3418350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa57 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.522648:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:0.0:1789023662.522654:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023662.523378:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2669f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:2362:x1875927007018752:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 790us (5353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.523389:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:2.0:1789023662.541533:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.541679:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007018880 00000100:00100000:3.0:1789023662.541689:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007018880 00000100:00100000:3.0:1789023662.541756:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1789023662.541767:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007018880:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:3.0:1789023662.541820:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.541839:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.541847:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023662.541852:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789023662.541860:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.541896:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.541910:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 8 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.541939:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7314e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875927024861440:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023662.542035:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a480 going to sleep for 11 seconds 00000100:00100000:1.0:1789023662.545080:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.545178:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007019008 00000100:00100000:0.0:1789023662.545187:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007019008 00002000:00100000:0.0:1789023662.545234:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e65df3d7b80 x1875927007019008/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:588/0 lens 504/0 e 0 to 0 dl 1789023673 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023662.545244:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65df3d7b80 with x1875927007019008 ext(0->8) 00010000:00010000:0.0:1789023662.545253:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 9 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.545269:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 9 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023662.545277:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65df3d7b80 00000100:00100000:0.0:1789023662.545312:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:0.0:1789023662.545322:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2362:x1875927007019008:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:0.0:1789023662.545884:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:2362:x1875927007019008:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 561us (812us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789023662.545898:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00100000:0.0:1789023662.545906:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e65df3d7b80 x1875927007019008/t4294967302(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:588/0 lens 504/448 e 0 to 0 dl 1789023673 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023662.545915:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65df3d7b80 with x1875927007019008 ext(0->8) 00010000:00010000:0.0:1789023662.545921:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 11 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.545935:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 11 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023662.545942:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65df3d7b80 00000100:00100000:3.0:1789023662.547576:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7314e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875927024861440:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023662.547610:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.549049:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.549142:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007019136 00000100:00100000:0.0:1789023662.549151:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007019136 00010000:00010000:0.0:1789023662.549188:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 11 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.549230:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1789023662.549240:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:2362:x1875927007019136:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023662.549255:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789023662.549277:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789023662.549280:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789023662 00002000:00010000:0.0:1789023662.549283:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789023662 00002000:00010000:0.0:1789023662.549285:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789023662 00010000:00010000:0.0:1789023662.549291:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 11 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.549324:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 11 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.549359:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418334 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa49 expref: 11 pid: 6696 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.549379:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023662.549383:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023662.549388:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.549398:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.549434:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023662.549523:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2362:x1875927007019136:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 284us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.549531:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00010000:00010000:1.0:1789023662.550092:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550112:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550137:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550147:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550155:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550161:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023662.550164:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550173:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550185:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.550192:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e5f4717/0xc3c1fcbfb3418373 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.550267:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6989c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007018880:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 8501us (8742us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023662.550275:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:1.0:1789023662.553120:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023662.553254:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007019392 00000100:00100000:3.0:1789023662.553265:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007019392 00000100:00100000:3.0:1789023662.553320:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1789023662.553331:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:10552:x1875927007019392:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:3.0:1789023662.553403:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418365 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa5e expref: 38 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023662.553678:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1789023662.553718:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1789023662.554506:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:3.0:1789023662.554565:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.554583:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.554592:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.554627:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.554653:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 42 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.554667:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7314e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875927024861568:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023662.554813:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789023662.563135:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7314e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875927024861568:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023662.563288:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.563950:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.564117:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007019520 00000100:00100000:0.0:1789023662.564125:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007019520 00010000:00010000:0.0:1789023662.564168:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 43 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.564209:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:0.0:1789023662.564219:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+43:2362:x1875927007019520:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023662.564253:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023662.564260:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 43 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.564271:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 43 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.564290:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb341831f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa3b expref: 43 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.564305:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:0.0:1789023662.564310:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.564319:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.564331:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.564364:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023662.564419:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:2362:x1875927007019520:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 201us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.564426:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00010000:00010000:2.0:1789023662.564980:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.564990:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789023662.565106:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:2.0:1789023662.565320:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1789023662.565430:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d266ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024861696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789023662.565528:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023662.565560:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2beeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023662.566584:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024861696 00000100:00100000:0.0:1789023662.566593:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024861696 00000100:00100000:0.0:1789023662.566663:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789023662.566672:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1875927024861696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1789023662.566724:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023662.566762:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1875927024861696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.566778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023662.568236:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d266ad80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024861696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789023662.568833:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789023662.568918:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024861824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789023662.568976:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023662.569010:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252be40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023662.569092:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024861824 00000100:00100000:0.0:1789023662.569099:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024861824 00000100:00100000:0.0:1789023662.569158:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023662.569168:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5848:x1875927024861824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789023662.570042:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5848:x1875927024861824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 799us (989us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1789023662.570051:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023662.571175:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024861824:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789023662.571266:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789023662.571320:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.571330:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.571350:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.571357:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023662.571362:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.571370:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.571397:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:1.0:1789023662.571399:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789023662.571405:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.571412:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341837a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789023662.571630:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789023662.571741:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789023662.571752:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328642273672ns, next at 329642271681ns, rc = 0 00000001:00080000:1.0:1789023662.571759:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789023662.571799:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:1.0:1789023662.571802:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789023662.571809:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418365 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa5e expref: 46 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.571930:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9af9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+45:10552:x1875927007019392:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 18600us (18818us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789023662.571939:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000020:00080000:1.0:1789023662.571944:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789023662.575923:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023662.575972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007019648 00000100:00100000:1.0:1789023662.575983:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007019648 00000100:00100000:1.0:1789023662.576049:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:1.0:1789023662.576069:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+45:10552:x1875927007019648:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023662.576096:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023662.576117:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418381 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa65 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.576204:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418381 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa65 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.576218:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418381 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa65 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.576235:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:1.0:1789023662.576238:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023662.576242:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e000, rc 0) 00000100:00100000:1.0:1789023662.576302:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:10552:x1875927007019648:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 235us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023662.576309:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 100 00000100:00100000:2.0:1789023662.582571:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023662.582663:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007019904 00000100:00100000:1.0:1789023662.582673:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007019904 00000100:00100000:1.0:1789023662.582730:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:1.0:1789023662.582739:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:10552:x1875927007019904:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023662.582970:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:10552:x1875927007019904:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 231us (407us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789023662.582978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:3.0:1789023662.696160:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023662.696335:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007020032 00000100:00100000:2.0:1789023662.696357:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007020032 00000100:00100000:2.0:1789023662.696418:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:2.0:1789023662.696427:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:10562:x1875927007020032:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:2.0:1789023662.696557:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696574:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696585:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696600:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696606:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696613:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696710:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696718:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696725:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023662.696779:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696802:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696808:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696815:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696821:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.696826:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696832:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696845:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023662.696848:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.696853:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696858:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418388 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696870:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696875:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696888:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696892:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.696895:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696901:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696909:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1900) 00010000:00010000:2.0:1789023662.696911:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.696914:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696919:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341838f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696934:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696940:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696946:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696950:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.696953:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696968:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696975:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023662.696978:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.696981:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.696987:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418396 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023662.697064:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:10562:x1875927007020032:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 637us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023662.697072:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:3.0:1789023662.754114:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023662.754347:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007020288 00000100:00100000:1.0:1789023662.754357:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007020288 00000100:00100000:1.0:1789023662.754423:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:1.0:1789023662.754434:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:10565:x1875927007020288:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023662.754454:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023662.754474:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341839d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa6c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758381:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758411:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758426:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758457:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758465:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758471:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758614:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758624:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758632:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023662.758643:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789023662.758741:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758749:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758768:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758774:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fe00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023662.758779:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758795:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758807:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:1.0:1789023662.758810:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023662.758815:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758821:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758834:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758846:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758852:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758856:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023662.758859:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758875:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758884:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65eea05500) 00010000:00010000:1.0:1789023662.758886:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023662.758889:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758895:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34183ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758946:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341839d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758961:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 49 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.758968:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:1.0:1789023662.758970:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023662.758972:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023662.759050:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10565:x1875927007020288:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 4617us (4945us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789023662.759070:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 102 00000100:00100000:1.0:1789023662.769539:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023662.769624:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007020416 00000100:00100000:2.0:1789023662.769634:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007020416 00000100:00100000:2.0:1789023662.769691:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:2.0:1789023662.769701:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10565:x1875927007020416:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1789023662.769767:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769794:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769805:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769830:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769863:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769870:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769876:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.769880:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769888:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769899:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023662.769902:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023662.769907:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.769913:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023662.771922:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10565:x1875927007020416:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 2214us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023662.771934:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 103 00000100:00100000:3.0:1789023662.775395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023662.775603:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007020672 00000100:00100000:1.0:1789023662.775613:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007020672 00000100:00100000:1.0:1789023662.775670:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1789023662.775681:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:10565:x1875927007020672:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023662.775935:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:10565:x1875927007020672:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 255us (548us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789023662.775943:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:3.0:1789023662.837906:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.838002:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007020928 00000100:00100000:0.0:1789023662.838012:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007020928 00000100:00100000:0.0:1789023662.838069:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:0.0:1789023662.838079:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:10575:x1875927007020928:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:0.0:1789023662.838104:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023662.838107:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789023662.838132:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa50 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.838153:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023662.838158:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023662.838170:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb34183c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa73 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.838273:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.838287:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.838314:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.838348:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.838371:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 50 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.838385:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024861952:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023662.838536:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789023662.843179:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.843298:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024861952:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023662.843329:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.843511:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007021056 00000100:00100000:0.0:1789023662.843518:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007021056 00010000:00010000:0.0:1789023662.843558:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 51 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.843595:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:0.0:1789023662.843606:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:2361:x1875927007021056:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023662.843620:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023662.843626:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 51 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.843667:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 51 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.843689:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34183b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa6c expref: 51 pid: 5846 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.843704:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023662.843709:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.843717:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.843725:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.843752:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023662.843820:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:2361:x1875927007021056:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 216us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.843827:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00010000:00010000:2.0:1789023662.844060:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.844068:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023662.844096:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789023662.844255:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb34183c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.844271:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.844278:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023662.844281:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789023662.844284:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05c00, rc 0) 00000100:00100000:2.0:1789023662.844312:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:10575:x1875927007020928:12345-192.168.203.48@tcp:101:bash.0 Request processed in 6236us (6416us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789023662.844319:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 104 00000100:00100000:3.0:1789023662.847215:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.847352:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007021312 00000100:00100000:0.0:1789023662.847361:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007021312 00000100:00100000:0.0:1789023662.847417:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 105 00000100:00100000:0.0:1789023662.847427:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:10575:x1875927007021312:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1789023662.847735:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.847752:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.847773:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789023662.847837:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:0.0:1789023662.847864:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a9ed2c1 reply state 0000000030db16c8 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.847873:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789023662.847964:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10575:x1875927007021312:12345-192.168.203.48@tcp:36:bash.0 Request processed in 538us (757us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789023662.847972:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 105 00000020:00080000:0.0:1789023662.847977:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789023662.850889:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.850906:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.850914:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.850920:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023662.850925:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.850933:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.850962:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023662.850965:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023662.850970:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.850977:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34183dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.852296:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023662.853047:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007021440 00000100:00100000:1.0:1789023662.853058:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007021440 00000100:00100000:1.0:1789023662.853125:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:1.0:1789023662.853136:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:10575:x1875927007021440:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023662.853158:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023662.853176:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa7a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.853287:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.853302:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.853310:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.853354:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 53 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.853368:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 53 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023662.853381:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024862080:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023662.853513:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789023662.860135:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.860306:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024862080:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023662.860333:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.860392:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007021568 00000100:00100000:3.0:1789023662.860399:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007021568 00010000:00010000:3.0:1789023662.860508:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 54 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.860541:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:3.0:1789023662.860550:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:2362:x1875927007021568:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023662.860564:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023662.860570:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 54 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.860580:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 54 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.860601:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34183ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa73 expref: 54 pid: 5847 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.860620:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023662.860632:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.860641:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.860649:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023662.860678:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023662.860726:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:2362:x1875927007021568:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 176us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023662.860734:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00010000:00010000:1.0:1789023662.861034:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.861042:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023662.861086:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789023662.861091:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023662.861110:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.861139:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34183e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.861154:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023662.861160:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:1.0:1789023662.861163:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023662.861165:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e600, rc 0) 00000100:00100000:1.0:1789023662.861209:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:10575:x1875927007021440:12345-192.168.203.48@tcp:101:bash.0 Request processed in 8076us (8921us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023662.861217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 106 00000100:00100000:1.0:1789023662.867633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023662.867706:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007021824 00000100:00100000:2.0:1789023662.867715:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007021824 00000100:00100000:2.0:1789023662.867770:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:2.0:1789023662.867792:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:10575:x1875927007021824:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:2.0:1789023662.868014:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10575:x1875927007021824:12345-192.168.203.48@tcp:35:bash.0 Request processed in 235us (389us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1789023662.868021:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:3.0:1789023662.969162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.969329:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007021952 00000100:00100000:0.0:1789023662.969348:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007021952 00000100:00100000:0.0:1789023662.969407:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:0.0:1789023662.969419:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:10581:x1875927007021952:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023662.969444:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023662.969466:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb34183f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa81 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.969556:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34183f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.969571:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34183f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.969599:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34183f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023662.969635:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789023662.969639:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023662.969656:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34183f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.969691:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb34183f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa81 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.969880:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34183f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa81 expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.969890:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023662.969893:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023662.969897:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05800, rc 0) 00000100:00100000:0.0:1789023662.969961:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10581:x1875927007021952:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 544us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.969969:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 107 00000100:00100000:3.0:1789023662.978264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023662.978465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007022080 00000100:00100000:2.0:1789023662.978505:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007022080 00000100:00100000:2.0:1789023662.978569:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:2.0:1789023662.978580:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10581:x1875927007022080:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023662.978599:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023662.978633:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa88 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978698:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978713:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978724:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978744:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978752:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978759:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978863:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418414 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978872:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978880:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023662.978914:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789023662.978918:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023662.978936:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978954:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418414 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978962:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978968:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978973:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978978:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.978982:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.978989:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979000:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023662.979003:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.979007:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979013:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418406 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979026:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979032:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979044:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979048:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023662.979051:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979056:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979065:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1900) 00010000:00010000:2.0:1789023662.979067:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023662.979070:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979075:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb341840d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979106:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34183ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa88 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979119:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418414 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa88 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.979127:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023662.979129:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023662.979132:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023662.979206:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10581:x1875927007022080:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 628us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023662.979224:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 108 00000100:00100000:1.0:1789023662.982897:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.982991:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007022464 00000100:00100000:0.0:1789023662.982999:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007022464 00000100:00100000:0.0:1789023662.983064:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789023662.983074:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:2364:x1875927007022464:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023662.983089:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023662.983112:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418414 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa88 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.983150:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023662.983156:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023662.983228:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:2364:x1875927007022464:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 155us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.983235:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1789023662.993296:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.993562:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007022336 00000100:00100000:0.0:1789023662.993573:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007022336 00000100:00100000:0.0:1789023662.993635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:0.0:1789023662.993646:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10581:x1875927007022336:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023662.993667:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023662.993686:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341841b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa8f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.993789:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.993804:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.993821:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.993854:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.993866:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 55 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.993901:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024862208:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023662.993985:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c84f20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023662.997062:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024862208:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023662.997090:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023662.997518:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023662.997751:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007022592 00000100:00100000:0.0:1789023662.997760:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007022592 00010000:00010000:0.0:1789023662.997812:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 56 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023662.997850:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:0.0:1789023662.997860:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:2362:x1875927007022592:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023662.997873:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023662.997881:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 56 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.997893:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 56 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.997913:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34183ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa7a expref: 56 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.997927:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023662.997932:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.997955:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.997963:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023662.998050:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023662.998107:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:2362:x1875927007022592:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 248us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023662.998115:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00010000:00010000:2.0:1789023662.999036:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.999048:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023662.999068:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789023662.999582:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341841b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.999603:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023662.999611:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023662.999614:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789023662.999618:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05e00, rc 0) 00000100:00100000:2.0:1789023663.000054:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10581:x1875927007022336:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 6408us (6765us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789023663.000063:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 109 00000100:00100000:3.0:1789023663.007869:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.007956:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007022848 00000100:00100000:0.0:1789023663.007965:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007022848 00000100:00100000:0.0:1789023663.008025:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1789023663.008036:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10581:x1875927007022848:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:0.0:1789023663.008052:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023663.008074:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418381 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa65 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.008092:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023663.008098:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023663.008161:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10581:x1875927007022848:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 126us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023663.008169:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:1.0:1789023663.012086:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023663.012172:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007022976 00000100:00100000:2.0:1789023663.012190:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007022976 00000100:00100000:2.0:1789023663.012240:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:2.0:1789023663.012249:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10581:x1875927007022976:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:2.0:1789023663.012337:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.012353:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.012376:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023663.012585:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1789023663.012675:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10581:x1875927007022976:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 426us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023663.012683:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 110 00000100:00100000:1.0:1789023663.015907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023663.016058:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007023104 00000100:00100000:2.0:1789023663.016068:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007023104 00000100:00100000:2.0:1789023663.016172:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:2.0:1789023663.016193:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:10581:x1875927007023104:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023663.016211:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023663.016231:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa96 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.016286:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.016297:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.016316:0:7654:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.016329:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.016342:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023663.016351:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023663.016355:0:7654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 55 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.016363:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07a00, rc 0) 00000100:00100000:2.0:1789023663.016420:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7251180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10581:x1875927007023104:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 239us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023663.016427:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 111 00000040:00080000:2.0:1789023663.113805:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023663.113816:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023663.113879:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789023663.113887:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789023663.114007:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d266aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024862336:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789023663.114165:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c6b8da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023663.130468:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.130691:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007023232 00000100:00100000:0.0:1789023663.130701:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007023232 00000100:00100000:0.0:1789023663.130759:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:0.0:1789023663.130769:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007023232:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789023663.130822:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789023663.130922:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007023232:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 154us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023663.130930:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:2.0:1789023663.131079:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d266aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024862336:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789023663.134775:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.134855:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007023360 00000100:00100000:0.0:1789023663.134864:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007023360 00000100:00100000:0.0:1789023663.134913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:0.0:1789023663.134922:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10583:x1875927007023360:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789023663.134991:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135006:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135018:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135094:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135102:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135109:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135131:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135138:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135158:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023663.135208:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789023663.135212:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023663.135224:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135235:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135241:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135249:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135255:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.135260:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135267:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135278:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:0.0:1789023663.135280:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023663.135285:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135290:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341843e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135315:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135321:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135326:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135331:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.135334:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135341:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135361:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e65c8ebd600) 00010000:00010000:0.0:1789023663.135364:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023663.135367:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135373:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418445 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135391:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135396:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135407:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135420:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.135423:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135429:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135437:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023663.135439:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023663.135443:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.135449:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341844c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023663.136628:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10583:x1875927007023360:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1699us (1855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023663.136639:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:3.0:1789023663.139171:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.139242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007023616 00000100:00100000:0.0:1789023663.139253:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007023616 00000100:00100000:0.0:1789023663.139308:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:0.0:1789023663.139318:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:10583:x1875927007023616:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023663.139346:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023663.139367:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418453 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfa9d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139461:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139512:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139522:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023663.139534:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789023663.139620:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139627:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139634:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139640:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.139644:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139662:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139674:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023663.139677:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789023663.139681:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139687:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb341845a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139727:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418453 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa9d expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139743:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:0.0:1789023663.139745:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789023663.139750:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04800/0xc3c1fcbfb3418453 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa9d expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.139760:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04800, rc 0) 00000100:00100000:0.0:1789023663.140583:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007023616:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1261us (1415us total) trans 4294967398 rc 301/301 00000100:00100000:0.0:1789023663.140592:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:3.0:1789023663.143733:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023663.143912:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007023744 00000100:00100000:2.0:1789023663.143923:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007023744 00000100:00100000:2.0:1789023663.144008:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:2.0:1789023663.144019:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007023744:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789023663.144053:0:7654:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789023663.144157:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007023744:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 139us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023663.144164:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:1.0:1789023663.147257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.148346:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007024000 00000100:00100000:0.0:1789023663.148358:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007024000 00000100:00100000:0.0:1789023663.148422:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:0.0:1789023663.148433:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007024000:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023663.148455:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023663.148458:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789023663.148499:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34183f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa81 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.148518:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023663.148523:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023663.148536:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418468 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfaa4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789023663.149139:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789023663.149720:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341846f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.149743:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341846f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.149754:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341846f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.149824:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418468 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaa4 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.149905:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341846f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaa4 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.149914:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd600) 00010000:00010000:0.0:1789023663.149917:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789023663.149920:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05c00, rc 0) 00000100:00100000:0.0:1789023663.150076:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:10583:x1875927007024000:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1644us (2827us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789023663.150084:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:1.0:1789023663.158900:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.160738:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007024256 00000100:00100000:0.0:1789023663.160751:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007024256 00000100:00100000:0.0:1789023663.160878:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:0.0:1789023663.160890:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:10583:x1875927007024256:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789023663.160952:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023663.160976:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341846f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaa4 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.160997:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd600) 00010000:00010000:0.0:1789023663.161020:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023663.161039:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161052:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161063:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161076:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161083:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161089:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161150:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161158:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161165:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161171:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.161175:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161260:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161276:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023663.161279:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023663.161284:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161290:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb341847d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161300:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161306:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161311:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161316:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.161319:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161324:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161331:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x29a4e875 (ffff8e65c8ebdc00) 00010000:00010000:0.0:1789023663.161334:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023663.161349:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.161355:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418484 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x29a4e875 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023663.161598:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007024256:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 709us (2705us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789023663.161605:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:1.0:1789023663.163946:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023663.164631:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007024384 00000100:00100000:2.0:1789023663.164642:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007024384 00000100:00100000:0.0:1789023663.164790:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:0.0:1789023663.164802:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:10583:x1875927007024384:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023663.164821:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023663.164840:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb341848b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfaab expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.164873:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.164888:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.164899:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.164992:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb341848b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.165012:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.165021:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:0.0:1789023663.165024:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789023663.165027:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05200, rc 0) 00000100:00100000:0.0:1789023663.165085:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:10583:x1875927007024384:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 286us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023663.165092:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 118 00000100:00100000:0.0:1789023663.170174:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.181829:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007024640 00000100:00100000:3.0:1789023663.181846:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007024640 00000100:00100000:3.0:1789023663.182162:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:3.0:1789023663.182174:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:10583:x1875927007024640:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789023663.182262:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.182280:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.182304:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789023663.182718:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1789023663.182727:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329253249118ns, next at 330253247129ns, rc = 0 00000004:00010000:3.0:1789023663.182821:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d50e6c5d reply state 00000000f36255c2 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.182831:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789023663.182931:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:10583:x1875927007024640:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 759us (12765us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789023663.182938:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 119 00000100:00100000:1.0:1789023663.187937:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:0.0:1789023663.188017:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.188029:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.188037:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.188043:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.188048:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.188056:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.188070:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:0.0:1789023663.188073:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789023663.188077:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.188083:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418499 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.188154:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007024768 00000100:00100000:3.0:1789023663.188163:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007024768 00000100:00100000:3.0:1789023663.188306:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:3.0:1789023663.188317:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:10583:x1875927007024768:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023663.188339:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023663.188363:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfab2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.188422:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.188435:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.188462:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:3.0:1789023663.188476:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789023663.188479:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713cc00, rc 0) 00000100:00100000:3.0:1789023663.188587:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:10583:x1875927007024768:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 272us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023663.188595:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 120 00000100:00100000:0.0:1789023663.192011:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.192077:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007024896 00000100:00100000:3.0:1789023663.192086:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007024896 00000100:00100000:3.0:1789023663.192158:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1789023663.192167:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007024896:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789023663.192445:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023663.192825:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2362:x1875927007024896:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 657us (821us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789023663.192834:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:0.0:1789023663.196329:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.196632:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007025152 00000100:00100000:1.0:1789023663.196641:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007025152 00000100:00100000:1.0:1789023663.196699:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789023663.196709:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:10583:x1875927007025152:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789023663.197077:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10583:x1875927007025152:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 368us (755us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789023663.197085:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789023663.200040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023663.200135:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007025408 00000100:00100000:2.0:1789023663.200144:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007025408 00000100:00100000:2.0:1789023663.200209:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:2.0:1789023663.200219:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10583:x1875927007025408:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789023663.200326:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0071500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10583:x1875927007025408:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 108us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023663.200333:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 121 00000100:00100000:0.0:1789023663.203723:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.203970:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007025536 00000100:00100000:1.0:1789023663.203980:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007025536 00000100:00100000:1.0:1789023663.204032:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:1.0:1789023663.204042:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:10583:x1875927007025536:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023663.204060:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023663.204079:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34184a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfab9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.204139:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34184ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.204153:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34184ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.204173:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34184ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023663.204206:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023663.204223:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34184ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.204248:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb34184a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab9 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.204265:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34184ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab9 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.204273:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:1.0:1789023663.204275:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789023663.204279:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e600, rc 0) 00000100:00100000:1.0:1789023663.204353:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:10583:x1875927007025536:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 312us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023663.204360:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 122 00000100:00100000:0.0:1789023663.216749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.216848:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007025664 00000100:00100000:1.0:1789023663.216858:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007025664 00000100:00100000:1.0:1789023663.216915:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:1.0:1789023663.216926:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2362:x1875927007025664:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023663.216942:0:7164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023663.216962:0:7164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfac0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789023663.217007:0:7164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa255af, blocks: 0x1 00010000:00010000:1.0:1789023663.217027:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1789023663.217031:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023663.217040:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 10 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.217060:0:7164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 10 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.217073:0:7164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fc00, rc 0) 00000100:00100000:1.0:1789023663.217132:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2362:x1875927007025664:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 208us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023663.217139:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:2.0:1789023663.222735:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.222799:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007025920 00000100:00100000:1.0:1789023663.222809:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007025920 00000100:00100000:1.0:1789023663.222861:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:1.0:1789023663.222871:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:10583:x1875927007025920:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789023663.222964:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:10583:x1875927007025920:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 94us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023663.222971:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 123 00000100:00100000:0.0:1789023663.226901:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.227145:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007026048 00000100:00100000:1.0:1789023663.227155:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007026048 00000100:00100000:1.0:1789023663.227213:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:1.0:1789023663.227223:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:10583:x1875927007026048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023663.227255:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023663.227272:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfac7 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.227302:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 11 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.227311:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023663.227316:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023663.227321:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.227365:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 11 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.228123:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 11 pid: 7164 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023663.228139:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024862464:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023663.228598:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023663.232997:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0ddc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024862464:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023663.233033:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.233052:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e200, rc 0) 00000100:00100000:2.0:1789023663.233354:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:10583:x1875927007026048:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 6131us (6459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023663.233365:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:0.0:1789023663.235098:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.235175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007026176 00000100:00100000:3.0:1789023663.235184:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007026176 00010000:00010000:3.0:1789023663.235222:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 11 pid: 7164 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.235300:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1789023663.235311:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:2361:x1875927007026176:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023663.235325:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023663.235357:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 11 pid: 7164 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.235380:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 11 pid: 7164 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.235425:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb34184b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac0 expref: 11 pid: 7164 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.235441:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023663.235446:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023663.235465:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.235475:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.235558:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 10 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.235573:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1875927024862592:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789023663.235657:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789023663.239245:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5831:1875927024862592:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789023663.239272:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023663.239327:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2361:x1875927007026176:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 4018us (4236us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023663.239346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:1.0:1789023663.243213:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.243305:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007026304 00000100:00100000:0.0:1789023663.243315:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007026304 00002000:00100000:0.0:1789023663.243574:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e65de0dfb80 x1875927007026304/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:589/0 lens 504/0 e 0 to 0 dl 1789023674 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023663.243585:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65de0dfb80 with x1875927007026304 ext(0->12) 00002000:00010000:0.0:1789023663.243591:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65de0dfb80 00000100:00100000:0.0:1789023663.243667:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789023663.243677:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2362:x1875927007026304:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789023663.244197:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:2362:x1875927007026304:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 520us (990us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789023663.244205:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00002000:00100000:0.0:1789023663.244212:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e65de0dfb80 x1875927007026304/t4294967308(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:589/0 lens 504/448 e 0 to 0 dl 1789023674 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023663.244220:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65de0dfb80 with x1875927007026304 ext(0->12) 00002000:00010000:0.0:1789023663.244223:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65de0dfb80 00000100:00100000:0.0:1789023663.247372:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.247547:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007026432 00000100:00100000:1.0:1789023663.247557:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007026432 00000100:00100000:1.0:1789023663.247612:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:1.0:1789023663.247622:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:10583:x1875927007026432:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789023663.290162:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000020:00080000:3.0:1789023663.290196:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e65c7ec6900 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789023663.290201:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65e7075400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e65c7ec6840 00000020:00080000:3.0:1789023663.290219:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65e7075100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65e726e000 00000020:00080000:0.0:1789023663.290286:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 0 00000020:00080000:0.0:1789023663.290627:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000001:00080000:3.0:1789023663.290856:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:3.0:1789023663.290870:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789023663.290889:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e64c252bb40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789023663.290894:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65d098b100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e64c252b480 00000020:00080000:3.0:1789023663.290897:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65d098b200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65e7268c00 00000020:00080000:3.0:1789023663.290918:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1789023663.290938:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1789023663.290957:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000100:00100000:3.0:1789023663.291093:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023663.291113:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024862720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789023663.291178:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023663.291314:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024862976:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789023663.291364:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023663.291389:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023663.291394:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024862848:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789023663.291416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023663.291458:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024862720 00000100:00100000:1.0:1789023663.291465:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024862720 00000100:00100000:1.0:1789023663.291537:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024862976 00000100:00100000:1.0:1789023663.291540:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024862976 00000100:00100000:1.0:1789023663.291554:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024862848 00000100:00100000:1.0:1789023663.291556:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024862848 00000100:00100000:1.0:1789023663.291571:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789023663.291579:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875927024862720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789023663.291603:0:7164:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1789023663.291629:0:7164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291661:0:7164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291671:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789023663.291675:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789023663.291680:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291707:0:7164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291722:0:7164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 11 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023663.291745:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024863104:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023663.291815:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f40b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789023663.291832:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789023663.291840:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1875927024862976:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789023663.291854:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1789023663.291877:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa255ae, atime: 0x6aa255ae, ctime: 0x6aa255ae, blocks: 0x1 00010000:00010000:1.0:1789023663.291882:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291892:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1789023663.291894:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023663.291900:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291915:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291923:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291931:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.291948:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789023663.292410:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3311:x1875927024862976:12345-0@lo:6:osp-syn-1-0.0 Request processed in 570us (1044us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789023663.292418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789023663.292438:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789023663.292445:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024862848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789023663.292567:0:6695:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789023663.292570:0:6695:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789023663 00002000:00010000:1.0:1789023663.292573:0:6695:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789023663.292575:0:6695:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789023663 -> 1789023663 00002000:00010000:1.0:1789023663.292577:0:6695:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789023663.292604:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3311:x1875927024862848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 160us (1187us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789023663.292611:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789023663.292631:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789023663.292736:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023663.292743:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.292752:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ee00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023663.292756:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.292766:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.292796:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.292817:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb34184ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.292835:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023663.292837:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023663.292838:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789023663.292871:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65f6c5b480/2, rc 0, transno 4294967309 00000100:00100000:1.0:1789023663.292876:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024862848:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1789023663.292887:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65de0dea00/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789023663.292891:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024862976:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1789023663.295015:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1789023663.295095:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789023663.296614:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.296736:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007026560 00000100:00100000:0.0:1789023663.296746:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007026560 00010000:00010000:0.0:1789023663.296973:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 12 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023663.297030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:0.0:1789023663.297041:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:2362:x1875927007026560:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023663.297056:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023663.297062:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 12 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.297075:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 12 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.297099:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023663.297104:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023663.297109:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.297119:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.297140:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023663.297189:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:2362:x1875927007026560:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 149us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023663.297196:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00010000:00010000:3.0:1789023663.297772:0:7164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418285 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa26 expref: 11 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.297800:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024863104:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023663.297821:0:7164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.297841:0:7164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.297850:0:7164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.297874:0:7164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.297883:0:7164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.297906:0:7164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789023663.298667:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023663.298675:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.298698:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023663.298703:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.298713:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.298729:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.298737:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb34184c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.298756:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023663.298758:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023663.298760:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023663.299084:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:10583:x1875927007026432:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 51461us (51716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023663.299094:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 124 00000100:00100000:3.0:1789023663.299709:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3312:x1875927024862720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6871us (7271us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789023663.299720:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:3.0:1789023663.299768:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65c6dcfb80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789023663.299774:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024862720:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789023663.305390:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.305528:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007026688 00000100:00100000:3.0:1789023663.305537:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007026688 00000100:00100000:3.0:1789023663.305589:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:3.0:1789023663.305598:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:2362:x1875927007026688:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789023663.342757:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:3.0:1789023663.342788:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1789023663.342811:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789023663.342826:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1789023663.343044:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007026688:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 37441us (37657us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023663.343055:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:1.0:1789023663.346039:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023663.346122:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007026944 00000100:00100000:2.0:1789023663.346132:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007026944 00000100:00100000:2.0:1789023663.346223:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:2.0:1789023663.346233:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:10583:x1875927007026944:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789023663.346284:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023663.346307:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb34184ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab9 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.346351:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:2.0:1789023663.346356:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023663.346382:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.346394:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.346404:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023663.346890:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000570b219e reply state 00000000925e66bd transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023663.346901:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023663.347031:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:10583:x1875927007026944:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 799us (998us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1789023663.347038:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 125 00000100:00100000:3.0:1789023663.350055:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.350128:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007027072 00000100:00100000:1.0:1789023663.350138:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007027072 00000100:00100000:1.0:1789023663.350192:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1789023663.350203:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007027072:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789023663.350438:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789023663.350442:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789023663 -> 1789023662 00002000:00010000:1.0:1789023663.350445:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789023662 00002000:00010000:1.0:1789023663.350447:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789023663 -> 1789023662 00002000:00010000:1.0:1789023663.350475:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789023663.350553:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007027072:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 351us (505us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789023663.350560:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00010000:00010000:0.0:1789023663.351568:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.351581:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.351588:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.351595:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023663.351599:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.351617:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.351632:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:0.0:1789023663.351635:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023663.351640:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.351647:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34184d1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.353811:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.353889:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007027328 00000100:00100000:0.0:1789023663.353898:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007027328 00000100:00100000:0.0:1789023663.353957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:0.0:1789023663.353968:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:10583:x1875927007027328:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789023663.354027:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.354042:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.354051:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.354078:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.354091:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 15 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023663.354121:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024863232:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023663.354198:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1b11c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023663.357193:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.357285:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024863232:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023663.357312:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.357375:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007027456 00000100:00100000:3.0:1789023663.357382:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007027456 00010000:00010000:3.0:1789023663.357415:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 16 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.357466:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1789023663.357475:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:2361:x1875927007027456:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023663.357518:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023663.357524:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 16 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.357535:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 16 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.357556:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaab expref: 16 pid: 5847 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.357573:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:3.0:1789023663.357577:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.357586:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.357594:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.357618:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023663.357672:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:2361:x1875927007027456:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 198us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023663.357679:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00010000:00010000:2.0:1789023663.357854:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357862:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357890:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357898:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357913:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357919:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023663.357923:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357930:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357940:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:2.0:1789023663.357942:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789023663.357946:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.357952:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb34184d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023663.358001:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:10583:x1875927007027328:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 4035us (4199us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789023663.358009:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 126 00000100:00100000:2.0:1789023663.362363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.362517:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007027584 00000100:00100000:3.0:1789023663.362540:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007027584 00000100:00100000:3.0:1789023663.362595:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1789023663.362605:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007027584:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789023663.362659:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.362679:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.362688:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023663.362692:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789023663.362696:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.362728:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 7 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.362743:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 7 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.362757:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024863360:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023663.362856:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789023663.365971:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024863360:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023663.366000:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023663.367708:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.367787:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007027712 00000100:00100000:0.0:1789023663.367797:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007027712 00010000:00010000:0.0:1789023663.367845:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 8 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023663.367877:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1789023663.367886:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007027712:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023663.367902:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023663.367924:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 8 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.367937:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 8 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.367957:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df7378ea/0xc3c1fcbfb34184bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfac7 expref: 8 pid: 6696 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.367972:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023663.367987:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023663.367992:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.368001:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023663.368033:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023663.368084:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007027712:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 199us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023663.368091:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00010000:00010000:3.0:1789023663.368357:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368367:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368405:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368413:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368420:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368426:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023663.368431:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368439:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368452:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.368459:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034c071f6/0xc3c1fcbfb34184df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.368546:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007027584:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 5943us (6190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023663.368555:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00010000:00010000:3.0:1789023663.369700:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023663.372744:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.372830:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007027968 00000100:00100000:3.0:1789023663.372849:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007027968 00000100:00100000:3.0:1789023663.372906:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:3.0:1789023663.372916:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:10583:x1875927007027968:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789023663.372987:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.373004:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.373016:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.373212:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.373223:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.373232:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.373262:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.373273:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 15 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.373286:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024863488:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023663.373386:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789023663.378680:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023663.378809:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007028096 00000100:00100000:1.0:1789023663.378818:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007028096 00010000:00010000:1.0:1789023663.378863:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 16 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023663.378898:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:1.0:1789023663.378907:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:2361:x1875927007028096:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023663.378921:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023663.378927:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 16 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.378940:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 16 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.378960:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:1.0:1789023663.378965:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.378973:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.378992:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.379009:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023663.379059:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:2361:x1875927007028096:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 153us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023663.379066:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00010000:00010000:3.0:1789023663.379270:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfab2 expref: 15 pid: 5846 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.379286:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024863488:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023663.379307:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.379315:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.379321:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023663.379534:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1789023663.379774:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789023663.379827:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1789023663.379911:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1875927024863616:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789023663.379960:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023663.380027:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789023663.381404:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024863616 00000100:00100000:2.0:1789023663.381414:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024863616 00000100:00100000:3.0:1789023663.381639:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789023663.381655:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7654:x1875927024863616:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789023663.381754:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7654:x1875927024863616:12345-0@lo:1000:mdt00_003.0 Request processed in 107us (1793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023663.381760:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789023663.381853:0:7654:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789023663.381859:0:7654:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:2.0:1789023663.381878:0:7654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65f6c5b480, transno 4294967309 00000004:00080000:2.0:1789023663.381915:0:7654:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65c6dcfb80, transno 4294967310 00000100:00100000:2.0:1789023663.381922:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c58000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1875927024863616:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789023663.382402:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789023663.382829:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d266ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1875927024863744:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789023663.382887:0:7654:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023663.383682:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7105e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023663.383770:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024863744 00000100:00100000:0.0:1789023663.383786:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024863744 00000100:00100000:0.0:1789023663.383827:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789023663.383847:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7654:x1875927024863744:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789023663.384091:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7654:x1875927024863744:12345-0@lo:1000:mdt00_003.0 Request processed in 255us (1203us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789023663.384098:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789023663.384261:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d266ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7654:1875927024863744:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789023663.384299:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384309:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384316:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384321:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023663.384326:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384406:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384424:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c8ebd800) 00010000:00010000:2.0:1789023663.384427:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023663.384432:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384439:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34184ed lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384795:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384801:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384807:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384812:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023663.384816:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384822:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.384831:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023663.385006:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023663.385014:0:7654:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 18 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.385025:0:7654:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 18 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.385033:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 18 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.385142:0:7654:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 18 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.385169:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024863872:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789023663.385284:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789023663.390210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.390304:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0fd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024863872:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789023663.390345:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390355:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418430 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390387:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390401:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390413:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390424:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390431:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390437:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390443:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023663.390456:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390773:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390796:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023663.390799:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023663.390804:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390810:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34184f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390821:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390827:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390833:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390837:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023663.390841:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390846:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390853:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023663.390855:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789023663.390857:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.390872:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34184e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.391102:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10583:x1875927007027968:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 18186us (18364us total) trans 4294967407 rc 0/0 00000100:00100000:3.0:1789023663.391111:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000020:00080000:3.0:1789023663.391117:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789023663.392265:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007028224 00000100:00100000:1.0:1789023663.392277:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007028224 00000100:00100000:1.0:1789023663.392328:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:1.0:1789023663.392351:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10581:x1875927007028224:12345-192.168.203.48@tcp:49:lfs.0 00000100:00100000:1.0:1789023663.392595:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10581:x1875927007028224:12345-192.168.203.48@tcp:49:lfs.0 Request processed in 258us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023663.392602:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000040:00080000:2.0:1789023663.392947:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023663.392952:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1789023663.396866:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000040:00080000:2.0:1789023663.396950:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789023663.396963:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789023663.397163:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007028480 00000100:00100000:3.0:1789023663.397173:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007028480 00000100:00100000:3.0:1789023663.397226:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:3.0:1789023663.397237:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10581:x1875927007028480:12345-192.168.203.48@tcp:58:lfs.0 00000040:00080000:3.0:1789023663.398053:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789023663.398190:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10581:x1875927007028480:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 952us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023663.398199:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 128 00000100:00100000:1.0:1789023663.406185:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.406344:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007028736 00000100:00100000:3.0:1789023663.406355:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007028736 00000100:00100000:3.0:1789023663.406413:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:3.0:1789023663.406424:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:10583:x1875927007028736:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789023663.407299:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789023663.407405:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1789023663.407769:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.407793:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.407818:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.407828:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.408105:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.408111:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.408134:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789023663.408233:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9afa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:10583:x1875927007028736:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1808us (2055us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1789023663.408242:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000020:00080000:3.0:1789023663.408247:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789023663.408599:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023663.408606:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.408613:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023663.408617:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.408625:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.408638:0:7644:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e65c6960000) 00010000:00010000:1.0:1789023663.408641:0:7644:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789023663.408665:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.408671:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34184fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023663.408692:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023663.408694:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023663.408696:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023663.446138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023663.446350:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007028864 00000100:00100000:2.0:1789023663.446359:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007028864 00000100:00100000:2.0:1789023663.446464:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 129 00000100:00100000:2.0:1789023663.446474:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:10585:x1875927007028864:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023663.446533:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023663.446552:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bface expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446610:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446624:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446636:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446662:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446671:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446678:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446932:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446943:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.446960:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.447286:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.447302:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 21 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023663.447317:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2668000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024864000:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023663.447404:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c68840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023663.450131:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2668000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024864000:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023663.450159:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.451575:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023663.452250:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007029120 00000100:00100000:0.0:1789023663.452261:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007029120 00000100:00100000:0.0:1789023663.452321:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1789023663.452343:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:5599:x1875927007029120:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789023663.452617:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:5599:x1875927007029120:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 287us (1048us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789023663.452640:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1789023663.456187:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023663.456276:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007029248 00000100:00100000:3.0:1789023663.456287:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007029248 00010000:00010000:3.0:1789023663.456327:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 23 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023663.456381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789023663.456391:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c2f84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:2362:x1875927007029248:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023663.456408:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023663.456414:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 23 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.456441:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 23 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.457313:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418422 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa8f expref: 23 pid: 5845 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.457336:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023663.457341:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.457351:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.457358:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023663.457400:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023663.457520:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c2f84050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:2362:x1875927007029248:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1084us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023663.457531:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00010000:00010000:2.0:1789023663.457921:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.457935:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023663.457980:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789023663.457985:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023663.458005:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458018:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458044:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458050:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458056:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458061:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023663.458065:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458071:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458080:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:2.0:1789023663.458082:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023663.458087:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458093:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458103:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458109:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458113:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458122:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023663.458125:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458129:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458137:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e65f41d1900) 00010000:00010000:2.0:1789023663.458139:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023663.458142:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458147:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458184:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bface expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458198:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bface expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023663.458205:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023663.458207:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023663.458209:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06600, rc 0) 00000100:00100000:2.0:1789023663.458239:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:10585:x1875927007028864:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 11767us (12112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023663.458246:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 129 00000001:00080000:0.0:1789023663.690314:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789023663.690342:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1789023663.690359:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000100:00100000:1.0:1789023664.110858:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023664.110905:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023664.110996:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007029504 00000100:00100000:3.0:1789023664.111007:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007029504 00000100:00100000:3.0:1789023664.111078:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:3.0:1789023664.111089:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007029504:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023664.111157:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007029504:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 70us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023664.111164:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:0.0:1789023664.111254:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007029376 00000100:00100000:0.0:1789023664.111260:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007029376 00000100:00100000:0.0:1789023664.111301:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 282 00000100:00100000:0.0:1789023664.111308:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007029376:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023664.111336:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0932c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007029376:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023664.111342:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 282 00000100:00080000:1.0:1789023664.111650:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023664.126790:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023664.127011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007029632 00000100:00100000:2.0:1789023664.127028:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007029632 00000100:00100000:2.0:1789023664.127107:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00100000:2.0:1789023664.127117:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007029632:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023664.127185:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007029632:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023664.127192:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 127 00000100:00080000:1.0:1789023664.127260:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023664.137760:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789023664.137792:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024864128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789023664.137855:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023664.141938:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024864128 00000100:00100000:2.0:1789023664.141952:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024864128 00000100:00100000:2.0:1789023664.142020:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789023664.142032:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875927024864128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789023664.142058:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1789023664.142150:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875927024864128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023664.142158:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789023664.142385:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024864128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789023664.399150:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789023664.426859:0:12078:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789023664.426869:0:12078:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789023664.426921:0:12078:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789023664.426927:0:12078:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789023664.460921:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789023664.460929:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789023664.460979:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789023664.460985:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789023664.461232:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65de0fc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024864256:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789023664.461367:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e724a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023664.470740:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023664.470781:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007029760 00000100:00100000:3.0:1789023664.470790:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007029760 00000100:00100000:3.0:1789023664.470850:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00100000:3.0:1789023664.470860:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:10596:x1875927007029760:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789023664.470894:0:7654:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789023664.471264:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:10596:x1875927007029760:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 404us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023664.471273:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 130 00000100:00080000:3.0:1789023664.471299:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023664.471972:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65de0fc380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024864256:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789023664.484595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023664.484629:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007030016 00000100:00100000:0.0:1789023664.484652:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007030016 00000100:00100000:0.0:1789023664.484702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:0.0:1789023664.484712:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:10596:x1875927007030016:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023664.484732:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023664.484752:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341851e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfad5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023664.487266:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023664.487289:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023664.487302:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023664.487315:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789023664.487500:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341851e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfad5 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023664.487522:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfad5 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023664.487547:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:1.0:1789023664.487551:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023664.487555:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e000, rc 0) 00000100:00100000:1.0:1789023664.487615:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:10596:x1875927007030016:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 2904us (3026us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789023664.487624:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:0.0:1789023664.497988:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023664.498043:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007030272 00000100:00100000:3.0:1789023664.498053:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007030272 00000100:00100000:3.0:1789023664.498102:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:0.0:1789023664.498107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023664.498112:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:10596:x1875927007030272:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789023664.498128:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007030400 00000100:00100000:0.0:1789023664.498132:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007030400 00000100:00100000:0.0:1789023664.498161:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789023664.498167:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:2364:x1875927007030400:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023664.498177:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023664.498182:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023664.498194:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfad5 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023664.498202:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023664.498210:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023664.498211:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023664.498214:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023664.498259:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:2364:x1875927007030400:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 92us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023664.498265:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00010000:00010000:3.0:1789023664.498381:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023664.498389:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023664.498396:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023664.498401:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023664.498406:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023664.498413:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023664.498422:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023664.498425:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789023664.498428:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023664.498435:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418533 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023664.502740:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:10596:x1875927007030272:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 4618us (4748us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1789023664.502761:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 132 00000040:00080000:0.0:1789023664.502847:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023664.502852:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789023664.504156:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789023664.504170:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789023664.511619:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023664.511677:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007030656 00000100:00100000:3.0:1789023664.511687:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007030656 00000100:00100000:3.0:1789023664.511742:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1789023664.511753:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:10596:x1875927007030656:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789023664.512393:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:10596:x1875927007030656:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 640us (780us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789023664.512402:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00010000:00010000:0.0:1789023665.417703:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023666.186958:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789023666.186985:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024864768:0@lo:400:kworker.0 00000100:00100000:1.0:1789023666.187003:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024864640:0@lo:400:kworker.0 00000100:00100000:0.0:1789023666.187069:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024864512:0@lo:400:kworker.0 00000100:00100000:3.0:1789023666.187129:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024864896:0@lo:400:kworker.0 00000100:00100000:2.0:1789023666.189680:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023666.189680:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023666.190023:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023666.190069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024864640 00000100:00100000:1.0:1789023666.190080:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024864640 00000100:00100000:1.0:1789023666.190136:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024864896 00000100:00100000:1.0:1789023666.190140:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024864896 00000100:00100000:1.0:1789023666.190167:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789023666.190176:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024864640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023666.190197:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024864384:0@lo:400:kworker.0 00000100:00100000:1.0:1789023666.190247:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024864640:12345-0@lo:400:kworker.0 Request processed in 70us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023666.190248:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023666.190259:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789023666.190284:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789023666.190292:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024864896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023666.190302:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024864384 00000100:00100000:2.0:1789023666.190307:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024864384 00000100:00100000:1.0:1789023666.190336:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024864896:12345-0@lo:400:kworker.0 Request processed in 44us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023666.190340:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789023666.190349:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789023666.190353:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024864384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023666.190396:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024864384:12345-0@lo:400:kworker.0 Request processed in 47us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023666.190402:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789023666.190456:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024864384:0@lo:400:kworker.0 00000100:00080000:2.0:1789023666.190524:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023666.190726:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024864768 00000100:00100000:0.0:1789023666.190731:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024864768 00000100:00100000:0.0:1789023666.190779:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789023666.190788:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875927024864768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023666.190828:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875927024864768:12345-0@lo:400:kworker.0 Request processed in 42us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023666.190842:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:3.0:1789023666.194507:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023666.194535:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023666.194584:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024865024:0@lo:400:kworker.0 00000100:00100000:3.0:1789023666.194641:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023666.194682:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024864512 00000100:00100000:3.0:1789023666.194690:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024864512 00000100:00100000:3.0:1789023666.194728:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789023666.194737:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024864512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023666.194796:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024864512:12345-0@lo:400:kworker.0 Request processed in 60us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023666.194803:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789023666.194824:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865024 00000100:00100000:3.0:1789023666.194827:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865024 00000100:00100000:3.0:1789023666.194856:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789023666.194861:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024865024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023666.194902:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024865024:12345-0@lo:400:kworker.0 Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023666.194908:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1789023666.194924:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789023666.194952:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024864512:0@lo:400:kworker.0 00000100:00100000:3.0:1789023666.194963:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789023666.194969:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967304 00000004:00080000:3.0:1789023666.194989:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65c84c1f80, transno 4294967301 00000004:00080000:3.0:1789023666.195001:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789023666.195010:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65de0dea00, transno 4294967304 00000100:00100000:3.0:1789023666.195014:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024865024:0@lo:400:kworker.0 00000100:00100000:3.0:1789023666.195276:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024864768:0@lo:400:kworker.0 00000100:00100000:1.0:1789023666.195284:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024864640:0@lo:400:kworker.0 00000100:00100000:3.0:1789023666.195323:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024864896:0@lo:400:kworker.0 00000040:00080000:2.0:1789023666.276188:0:12129:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023666.276197:0:12129:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023666.276239:0:12129:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789023666.276246:0:12129:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789023666.441031:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023666.441074:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007030912 00000100:00100000:2.0:1789023666.441083:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007030912 00000100:00100000:2.0:1789023666.441145:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00100000:2.0:1789023666.441156:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:10617:x1875927007030912:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023666.441180:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023666.441199:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341853a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfadc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023666.441296:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418541 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023666.441310:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023666.441324:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418541 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023666.441334:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789023666.441449:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341853a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfadc expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023666.441465:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418541 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfadc expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023666.441512:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:2.0:1789023666.441515:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789023666.441519:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06400, rc 0) 00000100:00100000:2.0:1789023666.441572:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:10617:x1875927007030912:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 417us (547us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789023666.441579:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 133 00000100:00080000:2.0:1789023666.441602:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789023666.441752:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023666.447152:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023666.453190:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031040 00000100:00100000:3.0:1789023666.453205:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031040 00000100:00100000:3.0:1789023666.453312:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:3.0:1789023666.453323:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:10617:x1875927007031040:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1789023666.453391:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453407:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453419:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453443:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453464:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453470:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453502:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023666.453507:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453514:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453525:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:3.0:1789023666.453528:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789023666.453533:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023666.453538:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341854f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023666.453609:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:10617:x1875927007031040:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 288us (6468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023666.453616:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 134 00000100:00100000:2.0:1789023666.585414:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023666.585513:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031168 00000100:00100000:0.0:1789023666.585523:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031168 00000100:00100000:0.0:1789023666.585595:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1789023666.585606:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007031168:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:0.0:1789023666.585622:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023666.585641:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7285453/0xc3c1fcbfb3418556 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfae3 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023666.585666:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa255ae, atime: 0x6aa255ae, ctime: 0x6aa255ae, blocks: 0xb 00010000:00010000:0.0:1789023666.585685:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1789023666.585688:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023666.585697:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7285453/0xc3c1fcbfb3418556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfae3 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023666.585714:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d7285453/0xc3c1fcbfb3418556 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfae3 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023666.585727:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04800, rc 0) 00000100:00100000:0.0:1789023666.585790:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007031168:12345-192.168.203.48@tcp:101:cat.0 Request processed in 186us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023666.585797:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00080000:2.0:1789023666.586322:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023666.597472:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023666.597600:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031296 00000100:00100000:0.0:1789023666.597611:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031296 00002000:00100000:0.0:1789023666.597659:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8e65d266b100 x1875927007031296/t0(0) o3->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:592/0 lens 488/0 e 0 to 0 dl 1789023677 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023666.597683:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65d266b100 with x1875927007031296 ext(0->4095) 00002000:00010000:0.0:1789023666.597689:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65d266b100 00000100:00100000:0.0:1789023666.597736:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:0.0:1789023666.597746:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007031296:12345-192.168.203.48@tcp:3:cat.0 00000100:00100000:0.0:1789023666.597994:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007031296:12345-192.168.203.48@tcp:3:cat.0 Request processed in 249us (532us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789023666.598001:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00002000:00100000:0.0:1789023666.598008:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8e65d266b100 x1875927007031296/t0(0) o3->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:592/0 lens 488/4536 e 0 to 0 dl 1789023677 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023666.598015:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65d266b100 with x1875927007031296 ext(0->4095) 00002000:00010000:0.0:1789023666.598018:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65d266b100 00000100:00100000:3.0:1789023666.700576:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789023666.700598:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024865152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023666.702398:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023666.703138:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865152 00000100:00100000:2.0:1789023666.703148:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865152 00000100:00100000:2.0:1789023666.703199:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789023666.703209:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024865152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023666.703246:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023666.703321:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024865152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023666.703329:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789023666.703445:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024865152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789023667.465872:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023668.490599:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789023668.799826:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:1.0:1789023668.799851:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1789023668.800454:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:1.0:1789023668.800465:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789023668.800470:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000001:00080000:1.0:1789023668.800533:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:1.0:1789023668.800544:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789023668.800553:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e65c6b8da80 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789023668.800559:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65d00c1800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e65c6b8d900 00000020:00080000:1.0:1789023668.800563:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65d00c1600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65f6f04000 00000020:00080000:2.0:1789023668.800715:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789023668.800959:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1789023669.241187:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023669.241248:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023669.241593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023669.241630:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023669.241659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023669.241707:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031680 00000100:00100000:1.0:1789023669.241720:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031680 00000100:00100000:1.0:1789023669.241840:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031808 00000100:00100000:1.0:1789023669.241844:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031808 00000100:00100000:1.0:1789023669.241875:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:1.0:1789023669.241888:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007031680:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023669.242106:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031424 00000100:00100000:2.0:1789023669.242112:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031424 00000100:00100000:2.0:1789023669.242149:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 284 00000100:00100000:2.0:1789023669.242157:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2362:x1875927007031424:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023669.242202:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007031680:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 315us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023669.242212:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:1.0:1789023669.242237:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:1.0:1789023669.242244:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007031808:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023669.249808:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0931850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2362:x1875927007031424:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 7631us (8685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023669.250766:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 284 00000100:00100000:1.0:1789023669.252249:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007031808:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 9987us (10570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023669.252267:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:1.0:1789023669.252344:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031936 00000100:00100000:1.0:1789023669.252356:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031936 00000100:00100000:1.0:1789023669.252436:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007031552 00000100:00100000:2.0:1789023669.252502:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:2.0:1789023669.252517:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2362:x1875927007031936:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023669.252547:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007031552 00000100:00100000:1.0:1789023669.252587:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00100000:1.0:1789023669.252594:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:2362:x1875927007031552:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023669.252746:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2362:x1875927007031936:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 224us (11447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023669.252755:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 131 00000100:00100000:1.0:1789023669.253071:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:2362:x1875927007031552:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 476us (11439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023669.253081:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 132 00000100:00080000:1.0:1789023669.253544:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789023669.253550:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023669.253560:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023669.258928:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024865280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023669.259039:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023669.259081:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865280 00000100:00100000:0.0:1789023669.259102:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865280 00000100:00080000:3.0:1789023669.259144:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023669.259191:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789023669.259203:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024865280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023669.259252:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023669.259316:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6e63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024865280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023669.259324:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789023669.260455:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789023669.260466:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1789023669.260685:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024865280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789023669.517437:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023670.537603:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023671.095827:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023671.096068:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007032064 00000100:00100000:2.0:1789023671.096079:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007032064 00000100:00100000:2.0:1789023671.096154:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00100000:2.0:1789023671.096167:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:10257:x1875927007032064:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789023671.096276:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:10257:x1875927007032064:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 113us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023671.096350:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 135 00000100:00080000:3.0:1789023671.096940:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023671.100257:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023671.100460:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007032320 00000100:00100000:3.0:1789023671.100471:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007032320 00000100:00100000:3.0:1789023671.100559:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:3.0:1789023671.100578:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:10257:x1875927007032320:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789023671.101427:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:10257:x1875927007032320:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 847us (1174us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789023671.101437:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:2.0:1789023671.305814:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024865408:0@lo:400:kworker.0 00000100:00100000:0.0:1789023671.305842:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024865664:0@lo:400:kworker.0 00000100:00100000:2.0:1789023671.305891:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023671.305966:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024865792:0@lo:400:kworker.0 00000100:00100000:1.0:1789023671.305998:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024865536:0@lo:400:kworker.0 00000100:00100000:0.0:1789023671.307953:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023671.308165:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865664 00000100:00100000:0.0:1789023671.308174:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865664 00000100:00100000:0.0:1789023671.308298:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789023671.308312:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024865664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023671.308644:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024865664:12345-0@lo:400:kworker.0 Request processed in 332us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023671.308652:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789023671.308910:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024865920:0@lo:400:kworker.0 00000100:00100000:2.0:1789023671.308945:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023671.308984:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865408 00000100:00100000:2.0:1789023671.308989:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865408 00000100:00100000:2.0:1789023671.309017:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1789023671.309023:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024865408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023671.309058:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024865408:12345-0@lo:400:kworker.0 Request processed in 35us (3168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023671.309072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1789023671.309108:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024865664:0@lo:400:kworker.0 00000100:00100000:2.0:1789023671.309116:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024865408:0@lo:400:kworker.0 00000100:00100000:0.0:1789023671.309146:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865920 00000100:00100000:0.0:1789023671.309151:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865920 00000100:00080000:2.0:1789023671.309157:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023671.309185:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789023671.309205:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d266ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024865920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023671.309250:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d266ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024865920:12345-0@lo:400:kworker.0 Request processed in 46us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023671.309256:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789023671.309875:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024865920:0@lo:400:kworker.0 00000100:00100000:3.0:1789023671.309932:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023671.310220:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865792 00000100:00100000:0.0:1789023671.310227:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865792 00000100:00080000:2.0:1789023671.310272:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023671.310282:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789023671.310292:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024865792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023671.310348:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024865792:12345-0@lo:400:kworker.0 Request processed in 58us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023671.310356:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789023671.310385:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024865792:0@lo:400:kworker.0 00000100:00100000:1.0:1789023671.314209:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023671.314266:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024866048:0@lo:400:kworker.0 00000100:00100000:1.0:1789023671.314301:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023671.314557:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024865536 00000100:00100000:0.0:1789023671.314566:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024865536 00000100:00100000:0.0:1789023671.314619:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789023671.314628:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024865536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023671.314791:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024865536:12345-0@lo:400:kworker.0 Request processed in 164us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023671.314798:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789023671.315641:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866048 00000100:00100000:2.0:1789023671.315649:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866048 00000100:00100000:2.0:1789023671.315713:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789023671.315722:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024866048:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789023671.315881:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789023671.316493:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024865536:0@lo:400:kworker.0 00000100:00100000:3.0:1789023671.316531:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024866048:0@lo:400:kworker.0 00000100:00100000:2.0:1789023671.316536:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024866048:12345-0@lo:400:kworker.0 Request processed in 813us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023671.316547:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1789023671.562353:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023671.818078:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024866176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023671.818145:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023671.818365:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866176 00000100:00100000:3.0:1789023671.818374:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866176 00000100:00100000:3.0:1789023671.818427:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789023671.818436:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024866176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023671.818469:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023671.818593:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024866176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023671.818612:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789023671.818674:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c6dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024866176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789023672.587307:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789023672.715137:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023672.715144:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023672.715404:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1789023672.715413:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1789023672.971654:0:12330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:01:11 (1789023671) 00010000:00010000:2.0:1789023673.609638:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789023673.917736:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789023673.917864:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789023673.917878:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1789023673.918035:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000100:00100000:0.0:1789023674.325743:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023674.327804:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007032576 00000100:00100000:2.0:1789023674.327817:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007032576 00000100:00100000:2.0:1789023674.327908:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:2.0:1789023674.327919:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:11329:x1875927007032576:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023674.327955:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023674.327975:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341855d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfaea expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328039:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328053:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328065:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328079:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328085:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328091:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328335:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418572 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328344:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418572 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328351:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418572 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023674.328360:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789023674.328544:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328551:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328558:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328568:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023674.328573:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328583:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328595:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:2.0:1789023674.328598:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023674.328603:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328609:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418564 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328620:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328626:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328631:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328647:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023674.328650:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328656:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328663:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e65f41d1a00) 00010000:00010000:2.0:1789023674.328666:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023674.328668:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.328673:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341856b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.329160:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341855d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaea expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.329175:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418572 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaea expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023674.329184:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:2.0:1789023674.329186:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023674.329189:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06000, rc 0) 00000100:00100000:2.0:1789023674.329250:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:11329:x1875927007032576:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1334us (3516us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1789023674.329258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00080000:0.0:1789023674.330066:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023674.343764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023674.343833:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023674.343908:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007032832 00000100:00100000:1.0:1789023674.343919:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007032832 00000100:00100000:1.0:1789023674.343976:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:1.0:1789023674.343987:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:11329:x1875927007032832:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789023674.344103:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:11329:x1875927007032832:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 117us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023674.344111:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 137 00000100:00100000:3.0:1789023674.344396:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007032704 00000100:00100000:3.0:1789023674.344401:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007032704 00000100:00100000:3.0:1789023674.344445:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1789023674.344452:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:2363:x1875927007032704:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023674.344463:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023674.344673:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418572 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaea expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023674.344712:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:3.0:1789023674.344718:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023674.344789:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:2363:x1875927007032704:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 337us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023674.344797:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023674.356847:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023674.356893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023674.356930:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023674.356963:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023674.356992:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007033344 00000100:00100000:2.0:1789023674.357002:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007033344 00000100:00100000:2.0:1789023674.357056:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:2.0:1789023674.357066:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007033344:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023674.357135:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007033344:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 70us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023674.357143:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 136 00000100:00100000:0.0:1789023674.357307:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007032960 00000100:00100000:0.0:1789023674.357313:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007032960 00000100:00100000:0.0:1789023674.357348:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 286 00000100:00100000:0.0:1789023674.357355:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007032960:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023674.357390:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007032960:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023674.357397:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 286 00000100:00080000:0.0:1789023674.357422:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023674.357562:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007033216 00000100:00100000:3.0:1789023674.357567:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007033216 00000100:00100000:3.0:1789023674.357635:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007033088 00000100:00100000:3.0:1789023674.357639:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007033088 00000100:00100000:3.0:1789023674.357660:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1789023674.357667:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927007033216:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023674.357765:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927007033216:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 98us (871us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023674.357772:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1789023674.357787:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:3.0:1789023674.357794:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007033088:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023674.357832:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007033088:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 38us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023674.357839:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00080000:0.0:1789023674.357900:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789023674.357903:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789023674.377938:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023674.377962:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024866304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023674.378028:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023674.378412:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866304 00000100:00100000:3.0:1789023674.378430:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866304 00000100:00080000:0.0:1789023674.378522:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023674.378942:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789023674.378959:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024866304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023674.379011:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023674.379190:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024866304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 235us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023674.382813:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024866304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023674.390379:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00010000:2.0:1789023674.633783:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789023674.761752:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023674.761761:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789023674.761794:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1789023674.761802:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789023675.659534:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023676.237802:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023676.239495:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007033472 00000100:00100000:3.0:1789023676.239508:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007033472 00000100:00100000:3.0:1789023676.239578:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00100000:3.0:1789023676.239591:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:11371:x1875927007033472:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023676.239611:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023676.239631:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfaf1 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240382:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240400:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240414:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240444:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240452:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240459:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240673:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240682:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240699:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240706:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023676.240710:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240718:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240731:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:3.0:1789023676.240734:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023676.240739:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240746:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418587 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240765:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240772:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240778:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240784:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023676.240787:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240794:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240802:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e65c6960300) 00010000:00010000:3.0:1789023676.240804:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023676.240807:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240813:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb341858e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240851:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418580 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaf1 expref: 15 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240861:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:3.0:1789023676.240864:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023676.240875:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaf1 expref: 15 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.240885:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d000, rc 0) 00000100:00100000:3.0:1789023676.242047:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:11371:x1875927007033472:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 2454us (4246us total) trans 0 rc 301/301 00000100:00100000:3.0:1789023676.242057:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 138 00000100:00080000:3.0:1789023676.242563:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023676.256037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.256345:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007033728 00000100:00100000:0.0:1789023676.256354:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007033728 00000100:00100000:0.0:1789023676.257016:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 139 00000100:00100000:0.0:1789023676.257030:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c6dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:11371:x1875927007033728:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:0.0:1789023676.257081:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023676.257112:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3417f0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf931 expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.257127:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1800) 00010000:00010000:0.0:1789023676.257137:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023676.257343:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.257358:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.257368:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.257379:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.257386:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.257393:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023676.259054:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789023676.259069:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.259079:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.259086:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.259103:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023676.259107:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.259115:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.259129:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65c8ebd900) 00010000:00010000:0.0:1789023676.259132:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023676.259136:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.259142:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418595 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789023676.259278:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011375c9c reply state 000000003d69f787 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023676.259287:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789023676.259386:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c6dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:11371:x1875927007033728:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 2357us (3355us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789023676.259394:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 139 00010000:00010000:0.0:1789023676.261420:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.261436:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.261444:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.261461:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023676.261466:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.261473:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.261549:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e65c8ebd600) 00010000:00010000:0.0:1789023676.261553:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023676.261558:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.261565:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341859c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023676.335129:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.335670:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007033856 00000100:00100000:1.0:1789023676.335681:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007033856 00000100:00100000:1.0:1789023676.335753:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:1.0:1789023676.335764:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+14:11378:x1875927007033856:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:1.0:1789023676.335788:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023676.335811:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb34185a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfaf8 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.335874:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34185aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.335887:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34185aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.335898:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34185aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023676.335930:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789023676.335934:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023676.335953:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34185aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.336010:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb34185a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaf8 expref: 16 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.336033:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34185aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaf8 expref: 15 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.336041:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:1.0:1789023676.336043:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789023676.336047:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f200, rc 0) 00000100:00100000:1.0:1789023676.336950:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:11378:x1875927007033856:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 1183us (1826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.336959:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:3.0:1789023676.398941:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.399098:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007033984 00000100:00100000:1.0:1789023676.399109:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007033984 00000100:00100000:1.0:1789023676.399169:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:1.0:1789023676.399178:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+15:11385:x1875927007033984:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023676.399197:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023676.399217:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb34185b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfaff expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399291:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399305:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399317:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399346:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399354:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399361:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399452:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb34185c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399460:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb34185c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399467:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb34185c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023676.399532:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789023676.399536:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023676.399554:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb34185c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399747:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399755:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399761:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399776:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023676.399780:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399787:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399798:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:1.0:1789023676.399802:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023676.399807:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399814:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb34185b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399899:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399907:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399913:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399918:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023676.399921:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399927:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399946:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e65eea05600) 00010000:00010000:1.0:1789023676.399949:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023676.399952:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399958:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34185bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.399993:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb34185b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaff expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.400007:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb34185c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaff expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.400014:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023676.400016:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789023676.400019:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707ea00, rc 0) 00000100:00100000:1.0:1789023676.400143:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7252300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:11385:x1875927007033984:12345-192.168.203.48@tcp:101:bash.0 Request processed in 909us (1153us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.400152:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:2.0:1789023676.410770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023676.410861:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007034240 00000100:00100000:3.0:1789023676.410871:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007034240 00000100:00100000:3.0:1789023676.410932:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:3.0:1789023676.410943:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+16:11385:x1875927007034240:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:3.0:1789023676.410962:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023676.410982:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34185cd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb06 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.411176:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.411191:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.411202:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.411459:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.411571:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023676.411584:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023676.417187:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789023676.417564:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.417581:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.417593:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418142:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418152:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418174:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418180:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023676.418184:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418193:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418206:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023676.418209:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023676.418214:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418220:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34185d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023676.418235:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019a6c1f7 reply state 000000004c4bcb90 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023676.418243:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789023676.418359:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34185cd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418374:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.418381:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:2.0:1789023676.418384:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023676.418391:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06000, rc 0) 00000100:00100000:2.0:1789023676.418560:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11385:x1875927007034240:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7617us (7800us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789023676.418569:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 142 00000100:00100000:3.0:1789023676.425800:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024866688:0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.425800:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024866432:0@lo:400:kworker.0 00000100:00100000:0.0:1789023676.425861:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024866816:0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.428189:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023676.428253:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024866944:0@lo:400:kworker.0 00000100:00100000:2.0:1789023676.428280:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024866560:0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.428285:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023676.428304:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023676.428323:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866432 00000100:00100000:2.0:1789023676.428325:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024867072:0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.428331:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866432 00000100:00100000:2.0:1789023676.428346:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023676.428371:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789023676.428379:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024867072 00000100:00100000:2.0:1789023676.428383:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024867072 00000100:00100000:1.0:1789023676.428391:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024866432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023676.428416:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789023676.428422:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024867072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.428437:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024866432:12345-0@lo:400:kworker.0 Request processed in 47us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.428445:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789023676.428453:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024867072:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.428458:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789023676.428505:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024867072:0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.428505:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024866432:0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.428527:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866944 00000100:00080000:2.0:1789023676.428530:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789023676.428530:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866944 00000100:00100000:2.0:1789023676.428549:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866560 00000100:00100000:2.0:1789023676.428551:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866560 00000100:00100000:2.0:1789023676.428570:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789023676.428577:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024866944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023676.428797:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024866944:12345-0@lo:400:kworker.0 Request processed in 36us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.428804:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789023676.428817:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789023676.428823:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024866560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023676.428863:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024866560:12345-0@lo:400:kworker.0 Request processed in 41us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.428870:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1789023676.428885:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023676.428901:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024866560:0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.429117:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024866944:0@lo:400:kworker.0 00000100:00100000:0.0:1789023676.429243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023676.429730:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866816 00000100:00100000:1.0:1789023676.429736:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866816 00000100:00100000:1.0:1789023676.429786:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789023676.429794:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024866816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023676.429899:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024866816:12345-0@lo:400:kworker.0 Request processed in 105us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.429905:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1789023676.429969:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789023676.430157:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024866816:0@lo:400:kworker.0 00010000:00010000:0.0:1789023676.433970:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.433987:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.433995:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.434001:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023676.434006:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.434031:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.434060:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65c6960300) 00010000:00010000:0.0:1789023676.434063:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023676.434068:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.434075:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb34185db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.434561:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023676.438948:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.439173:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007034368 00000100:00100000:1.0:1789023676.439182:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007034368 00000100:00100000:1.0:1789023676.439246:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:1.0:1789023676.439257:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007034368:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023676.439274:0:7164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023676.439294:0:7164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb0d expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789023676.439320:0:7164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023676.439339:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1789023676.439356:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023676.439365:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 6 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.439386:0:7164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 6 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.439400:0:7164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e000, rc 0) 00000100:00100000:1.0:1789023676.439455:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007034368:12345-192.168.203.48@tcp:101:bash.0 Request processed in 200us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.439462:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00080000:3.0:1789023676.439619:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023676.446035:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024866688 00000100:00100000:2.0:1789023676.446198:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024866688 00000100:00100000:2.0:1789023676.446298:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789023676.446310:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024866688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023676.446468:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024866688:12345-0@lo:400:kworker.0 Request processed in 160us (11909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.446491:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1789023676.447847:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023676.447897:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024866688:0@lo:400:kworker.0 00000100:00100000:2.0:1789023676.448288:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.448620:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007034496 00000100:00100000:1.0:1789023676.448627:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007034496 00000100:00100000:1.0:1789023676.448720:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:1.0:1789023676.448731:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:11385:x1875927007034496:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023676.448750:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023676.448770:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb14 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.448809:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 7 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.448819:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023676.448823:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023676.448841:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.448873:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 7 pid: 7164 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.448888:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 7 pid: 7164 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.448902:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875927024867200:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023676.448982:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d8e78b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023676.452914:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.452990:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007034624 00000100:00100000:0.0:1789023676.453000:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007034624 00010000:00010000:0.0:1789023676.453040:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 8 pid: 7164 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.453102:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6694:1875927024867200:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023676.453130:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.453148:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f600, rc 0) 00000100:00100000:0.0:1789023676.453209:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:1.0:1789023676.453210:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:11385:x1875927007034496:12345-192.168.203.48@tcp:101:bash.0 Request processed in 4481us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.453217:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1789023676.453220:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007034624:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023676.453234:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023676.453255:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 7 pid: 7164 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.453269:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 7 pid: 7164 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.453301:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094f72eda/0xc3c1fcbfb34185f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb0d expref: 7 pid: 7164 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.453337:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023676.453450:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023676.453460:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.453470:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.453549:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023676.453973:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1875927024867328:192.168.203.48@tcp:105: 00000100:00100000:0.0:1789023676.454192:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c637b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789023676.459432:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5831:1875927024867328:192.168.203.48@tcp:105: 00010000:00010000:0.0:1789023676.459460:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023676.459556:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007034624:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 6336us (6650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023676.459573:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:3.0:1789023676.459802:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.459961:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007034880 00000100:00100000:0.0:1789023676.459968:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007034880 00000100:00100000:0.0:1789023676.460014:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:0.0:1789023676.460022:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:11385:x1875927007034880:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:0.0:1789023676.460800:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11385:x1875927007034880:12345-192.168.203.48@tcp:35:bash.0 Request processed in 775us (996us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1789023676.460824:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1789023676.562041:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023676.562163:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007035136 00000100:00100000:2.0:1789023676.562173:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007035136 00000100:00100000:2.0:1789023676.562243:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:2.0:1789023676.562253:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11395:x1875927007035136:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023676.562277:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023676.562296:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34185fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb1b expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023676.562383:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789023676.562536:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34185fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb1b expref: 21 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.562551:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:2.0:1789023676.562574:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023676.562581:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34185fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb1b expref: 21 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.562595:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023676.562652:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11395:x1875927007035136:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 400us (620us total) trans 4294967420 rc 301/301 00000100:00100000:2.0:1789023676.562659:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 143 00000100:00100000:3.0:1789023676.570599:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.570705:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007035392 00000100:00100000:0.0:1789023676.570716:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007035392 00000100:00100000:0.0:1789023676.570788:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:0.0:1789023676.570800:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11395:x1875927007035392:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789023676.571029:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:11395:x1875927007035392:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 230us (439us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789023676.571037:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:3.0:1789023676.677074:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023676.677154:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007035520 00000100:00100000:2.0:1789023676.677165:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007035520 00000100:00100000:2.0:1789023676.677240:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 144 00000100:00100000:2.0:1789023676.677607:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:11401:x1875927007035520:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023676.677643:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023676.677664:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb341860c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb22 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.677739:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.677753:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.677764:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023676.677797:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789023676.677802:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023676.677818:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.677876:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb341860c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb22 expref: 23 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.677895:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb22 expref: 22 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.677902:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023676.677905:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023676.677908:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06200, rc 0) 00000100:00100000:2.0:1789023676.677974:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:11401:x1875927007035520:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 725us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.677980:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 144 00010000:00010000:3.0:1789023676.681730:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023676.686405:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.686626:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007035776 00000100:00100000:1.0:1789023676.686637:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007035776 00000100:00100000:1.0:1789023676.686703:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:1.0:1789023676.686713:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:11401:x1875927007035776:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023676.686734:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023676.686755:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341861a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb29 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.687131:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb3418621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.687146:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb3418621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.687157:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb3418621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023676.687168:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789023676.687299:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341861a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb29 expref: 25 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.687732:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb3418621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb29 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.687743:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:1.0:1789023676.687746:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023676.687750:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fe00, rc 0) 00000100:00100000:1.0:1789023676.687814:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:11401:x1875927007035776:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1102us (1418us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1789023676.687822:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:3.0:1789023676.696125:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023676.696175:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.696351:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007035904 00000100:00100000:0.0:1789023676.696361:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007035904 00000100:00100000:0.0:1789023676.696425:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1789023676.696436:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:2363:x1875927007035904:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023676.696451:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023676.696516:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb3418621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb29 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.696552:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:0.0:1789023676.696557:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023676.696617:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:2363:x1875927007035904:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 183us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023676.696625:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789023676.696818:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007036160 00000100:00100000:2.0:1789023676.696823:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007036160 00000100:00100000:2.0:1789023676.696860:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:2.0:1789023676.696868:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:11401:x1875927007036160:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023676.696896:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023676.696911:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb341862f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb30 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.696997:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418636 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.697009:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418636 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.697020:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418636 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023676.697046:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789023676.697161:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb341862f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb30 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.697176:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418636 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb30 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.697184:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:2.0:1789023676.697187:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789023676.697190:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07400, rc 0) 00000100:00100000:2.0:1789023676.697233:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11401:x1875927007036160:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 366us (1057us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789023676.697240:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:3.0:1789023676.716980:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.717063:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007036288 00000100:00100000:1.0:1789023676.717074:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007036288 00000100:00100000:1.0:1789023676.717157:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:1.0:1789023676.717168:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007036288:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:1.0:1789023676.717209:0:7164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.717244:0:7164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.717253:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023676.717257:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789023676.717262:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.717298:0:7164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 6 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.717312:0:7164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 6 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.717326:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7164:1875927024867456:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023676.717415:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023676.722953:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.723272:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007036416 00000100:00100000:0.0:1789023676.723282:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007036416 00002000:00100000:0.0:1789023676.723331:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e65f40eb800 x1875927007036416/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:602/0 lens 504/0 e 0 to 0 dl 1789023687 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023676.723363:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f40eb800 with x1875927007036416 ext(0->12) 00010000:00010000:0.0:1789023676.723372:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 7 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.723546:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 7 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023676.723564:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65f40eb800 00000100:00100000:0.0:1789023676.723600:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789023676.723610:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007036416:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:0.0:1789023676.724818:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2362:x1875927007036416:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 1203us (1869us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789023676.724830:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00002000:00100000:0.0:1789023676.724838:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e65f40eb800 x1875927007036416/t4294967305(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:602/0 lens 504/448 e 0 to 0 dl 1789023687 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023676.724848:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f40eb800 with x1875927007036416 ext(0->12) 00010000:00010000:0.0:1789023676.724857:0:6701:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 9 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.724872:0:6701:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 9 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023676.724879:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65f40eb800 00000100:00100000:2.0:1789023676.725257:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7164:1875927024867456:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023676.725282:0:7164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023676.733181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.733294:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007036544 00000100:00100000:1.0:1789023676.733304:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007036544 00010000:00010000:1.0:1789023676.733344:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 9 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.733578:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1789023676.733591:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007036544:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023676.733607:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789023676.733640:0:6710:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789023676.733643:0:6710:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789023676 00002000:00010000:1.0:1789023676.733645:0:6710:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789023676 00002000:00010000:1.0:1789023676.733647:0:6710:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789023676 00010000:00010000:1.0:1789023676.733654:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 9 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.733668:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 9 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.733698:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb34185f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb14 expref: 9 pid: 6694 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.733714:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789023676.733719:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789023676.733724:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.733734:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.733912:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023676.733964:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007036544:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 376us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.733972:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00010000:00010000:2.0:1789023676.734097:0:7164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734106:0:7164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734129:0:7164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734148:0:7164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734156:0:7164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734163:0:7164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023676.734167:0:7164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734176:0:7164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734188:0:7164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.734196:0:7164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418644 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023676.734240:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007036288:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 17074us (17268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.734466:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:3.0:1789023676.745585:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.745795:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007036800 00000100:00100000:0.0:1789023676.745818:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007036800 00000100:00100000:0.0:1789023676.745890:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:0.0:1789023676.745900:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11401:x1875927007036800:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:0.0:1789023676.745957:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418636 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb30 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789023676.746235:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789023676.746824:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789023676.748037:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1789023676.748738:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.749170:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.749181:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.749223:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.749240:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 29 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023676.749263:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875927024867584:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023676.749350:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c637b840 going to sleep for 11 seconds 00000100:00100000:0.0:1789023676.755085:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c5f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5849:1875927024867584:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023676.755118:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023676.757165:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023676.757776:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007036928 00000100:00100000:0.0:1789023676.757787:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007036928 00010000:00010000:0.0:1789023676.757830:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 30 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023676.757866:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:0.0:1789023676.757875:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:2362:x1875927007036928:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023676.757889:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023676.757896:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 30 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.757908:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 30 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.757927:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34185e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb06 expref: 30 pid: 5846 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.757944:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:0.0:1789023676.757949:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.757959:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.757966:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023676.758001:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023676.758206:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.758225:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789023676.758368:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1789023676.758649:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1789023676.759114:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875927024867712:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789023676.759167:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023676.759246:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023676.759349:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:2362:x1875927007036928:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1472us (2189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023676.759358:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:2.0:1789023676.760985:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024867712 00000100:00100000:2.0:1789023676.760998:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024867712 00000100:00100000:2.0:1789023676.761133:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789023676.761157:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1875927024867712:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789023676.761272:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1875927024867712:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 117us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.761287:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023676.761355:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875927024867712:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789023676.762369:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789023676.762463:0:5849:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875927024867840:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789023676.762543:0:5849:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023676.762944:0:5849:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c252b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789023676.763033:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024867840 00000100:00100000:0.0:1789023676.763111:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024867840 00000100:00100000:0.0:1789023676.763153:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789023676.763161:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875927024867840:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789023676.763769:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1875927024867840:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 607us (1224us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789023676.763778:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023676.764123:0:5849:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f40e9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5849:1875927024867840:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789023676.764185:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789023676.764230:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.764240:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.764374:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.764382:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023676.764387:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.764644:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.764661:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:1.0:1789023676.764664:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789023676.764669:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.764676:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341864b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789023676.765105:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789023676.765204:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1789023676.765214:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342835736341ns, next at 343835734156ns, rc = 0 00000001:00080000:1.0:1789023676.765222:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789023676.765379:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1a00) 00010000:00010000:1.0:1789023676.765383:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789023676.765454:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418636 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb30 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.765991:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9afa850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11401:x1875927007036800:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 20090us (20414us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789023676.766000:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00000020:00080000:1.0:1789023676.766005:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789023676.770861:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023676.771131:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007037056 00000100:00100000:2.0:1789023676.771140:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007037056 00000100:00100000:2.0:1789023676.771228:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00100000:2.0:1789023676.771240:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11401:x1875927007037056:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023676.771263:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023676.771295:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418652 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb37 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.771355:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418652 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb37 expref: 33 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.771369:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418652 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb37 expref: 33 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.771386:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023676.771400:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023676.771404:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023676.771463:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+33:11401:x1875927007037056:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 225us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023676.771471:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 147 00000100:00100000:3.0:1789023676.775171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023676.775431:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007037312 00000100:00100000:2.0:1789023676.775442:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007037312 00000100:00100000:2.0:1789023676.776500:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:2.0:1789023676.776531:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+33:11401:x1875927007037312:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023676.776981:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:11401:x1875927007037312:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 455us (1820us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789023676.776988:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789023676.872199:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023676.873137:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007037568 00000100:00100000:2.0:1789023676.873148:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007037568 00000100:00100000:2.0:1789023676.873221:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 148 00000100:00100000:2.0:1789023676.873232:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:11411:x1875927007037568:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023676.873271:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023676.873292:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418659 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb3e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023676.873413:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789023676.873654:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418659 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb3e expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.873669:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:2.0:1789023676.873671:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023676.873677:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3418659 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb3e expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.873704:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023676.873776:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:11411:x1875927007037568:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 546us (1584us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1789023676.873783:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 148 00000100:00100000:3.0:1789023676.879864:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.880082:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007037696 00000100:00100000:1.0:1789023676.880093:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007037696 00000100:00100000:1.0:1789023676.880150:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00100000:1.0:1789023676.880161:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:11411:x1875927007037696:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:1.0:1789023676.880317:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.880333:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.880345:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.880599:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.880608:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.880615:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883682:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883714:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883725:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023676.883775:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883787:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883810:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883817:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883824:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023676.883828:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883835:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883848:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023676.883851:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023676.883856:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883867:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883887:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883894:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883900:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883905:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ee00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023676.883915:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883919:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883925:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65eea05300) 00010000:00010000:1.0:1789023676.883926:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023676.883928:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883932:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb341866e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883945:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883948:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883952:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883955:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023676.883956:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883959:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883963:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023676.883964:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023676.883969:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.883973:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.884385:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:11411:x1875927007037696:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 4221us (4526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.884400:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 149 00000100:00100000:3.0:1789023676.887579:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.888593:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007037952 00000100:00100000:1.0:1789023676.888608:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007037952 00000100:00100000:1.0:1789023676.888782:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1789023676.888795:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:11411:x1875927007037952:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023676.889038:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+36:11411:x1875927007037952:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 246us (1474us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789023676.889047:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1789023676.938052:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024867968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023676.938170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023676.938638:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024867968 00000100:00100000:0.0:1789023676.938649:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024867968 00000100:00100000:0.0:1789023676.938790:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789023676.938801:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875927024867968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023676.938823:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023676.938883:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875927024867968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023676.938890:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789023676.938957:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024867968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023676.941004:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023676.941162:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007038208 00000100:00100000:2.0:1789023676.941186:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007038208 00000100:00100000:2.0:1789023676.941241:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:2.0:1789023676.941259:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+36:11414:x1875927007038208:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023676.941278:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023676.941297:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341867c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb45 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941375:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941389:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941401:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941416:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941423:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941429:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941563:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941582:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941589:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023676.941605:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789023676.941705:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941713:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941720:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941726:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023676.941730:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941738:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941749:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023676.941753:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023676.941758:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941763:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418683 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941775:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941780:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941795:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941799:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023676.941802:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941807:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941815:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023676.941817:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023676.941820:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941825:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341868a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941866:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341867c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941879:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023676.941887:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023676.941889:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023676.941891:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07400, rc 0) 00000100:00100000:2.0:1789023676.941959:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:11414:x1875927007038208:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 711us (963us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789023676.941975:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:3.0:1789023676.947968:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023676.948104:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007038336 00000100:00100000:1.0:1789023676.948124:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007038336 00000100:00100000:1.0:1789023676.948179:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:1.0:1789023676.948189:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:11414:x1875927007038336:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1789023676.948259:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948276:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948300:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948326:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948333:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948339:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948345:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ec00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023676.948350:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948357:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948368:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023676.948371:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789023676.948376:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023676.948382:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb341869f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023676.948469:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:11414:x1875927007038336:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 281us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023676.948516:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:3.0:1789023676.951239:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023676.951358:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007038592 00000100:00100000:2.0:1789023676.951374:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007038592 00000100:00100000:2.0:1789023676.951447:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:2.0:1789023676.951457:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:11414:x1875927007038592:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023676.951735:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+39:11414:x1875927007038592:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 280us (510us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789023676.951743:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:3.0:1789023677.283458:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023677.284135:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007038848 00000100:00100000:2.0:1789023677.284147:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007038848 00000100:00100000:2.0:1789023677.284199:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:2.0:1789023677.284211:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+39:11445:x1875927007038848:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789023677.284233:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023677.284269:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34186a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb4c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.284364:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34186ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.284379:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34186ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.284392:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34186ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023677.284403:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789023677.284546:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34186a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb4c expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.284581:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34186ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb4c expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.284590:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023677.284593:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023677.284596:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06c00, rc 0) 00000100:00100000:2.0:1789023677.284660:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:11445:x1875927007038848:12345-192.168.203.48@tcp:101:cat.0 Request processed in 452us (1212us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789023677.284668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 152 00000100:00100000:3.0:1789023677.289054:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023677.289392:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007039104 00000100:00100000:2.0:1789023677.289402:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007039104 00000100:00100000:2.0:1789023677.289463:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:2.0:1789023677.289474:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:11445:x1875927007039104:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:2.0:1789023677.289771:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:11445:x1875927007039104:12345-192.168.203.48@tcp:35:cat.0 Request processed in 299us (787us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789023677.289779:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:3.0:1789023677.297538:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023677.297614:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007039232 00000100:00100000:1.0:1789023677.297636:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007039232 00000100:00100000:1.0:1789023677.297709:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1789023677.297719:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c2f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:2363:x1875927007039232:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023677.297733:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023677.297756:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34186ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb4c expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.297785:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023677.297791:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023677.297849:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c2f86c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:2363:x1875927007039232:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 130us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023677.297857:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789023677.353658:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023677.353832:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007039488 00000100:00100000:1.0:1789023677.353843:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007039488 00000100:00100000:1.0:1789023677.353957:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 153 00000100:00100000:1.0:1789023677.353968:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:11451:x1875927007039488:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:1.0:1789023677.353993:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023677.353997:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789023677.354020:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb22 expref: 41 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.354037:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023677.354042:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023677.354055:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb34186bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb53 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.354144:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.354168:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.354178:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.354213:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.354226:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 41 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023677.354240:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024868096:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023677.354333:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1b119c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023677.357587:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024868096:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023677.357618:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023677.358843:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023677.359440:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007039616 00000100:00100000:0.0:1789023677.359452:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007039616 00010000:00010000:0.0:1789023677.359632:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 42 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023677.359725:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:0.0:1789023677.359735:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:2361:x1875927007039616:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023677.359751:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023677.359757:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 42 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.359783:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 42 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.359806:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb45 expref: 42 pid: 5846 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.359827:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:0.0:1789023677.359833:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.359842:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.359850:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.359880:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023677.359956:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2667480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:2361:x1875927007039616:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 222us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023677.359963:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00010000:00010000:1.0:1789023677.360425:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.360434:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023677.360453:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789023677.360647:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb34186bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 42 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.360682:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 41 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.360702:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023677.360705:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789023677.360707:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707ee00, rc 0) 00000100:00100000:1.0:1789023677.360743:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:11451:x1875927007039488:12345-192.168.203.48@tcp:101:dd.0 Request processed in 6777us (7095us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789023677.360750:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 153 00000100:00100000:2.0:1789023677.362933:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023677.363008:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007039872 00000100:00100000:3.0:1789023677.363018:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007039872 00000100:00100000:3.0:1789023677.363072:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 154 00000100:00100000:3.0:1789023677.363082:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:11451:x1875927007039872:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:3.0:1789023677.363651:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023677.363671:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023677.363693:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023677.363751:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1789023677.363777:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067d085ba reply state 00000000bd44dc69 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023677.363786:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789023677.363925:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+44:11451:x1875927007039872:12345-192.168.203.48@tcp:36:dd.0 Request processed in 844us (999us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789023677.363932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 154 00000020:00080000:3.0:1789023677.363937:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789023677.373420:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.373439:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.373448:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.373454:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023677.373460:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.373468:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.373505:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023677.373508:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023677.373513:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.373538:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb34186d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023677.654593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023677.654706:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007040000 00000100:00100000:1.0:1789023677.654717:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007040000 00000100:00100000:1.0:1789023677.654778:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00100000:1.0:1789023677.654789:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+43:11465:x1875927007040000:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:1.0:1789023677.654812:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023677.654832:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb34186d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb5a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.654896:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.654911:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.654923:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.654935:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.654943:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.654950:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.655034:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.655057:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 44 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.655065:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.655096:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 44 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.655109:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 44 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023677.655121:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024868224:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023677.655268:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1b11a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023677.658614:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023677.659067:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024868224:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023677.659094:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023677.659168:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007040256 00000100:00100000:0.0:1789023677.659175:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007040256 00000100:00100000:0.0:1789023677.659232:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:0.0:1789023677.659254:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+45:9982:x1875927007040256:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789023677.659654:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:9982:x1875927007040256:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 411us (1047us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789023677.659662:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:3.0:1789023677.662044:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023677.662182:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007040384 00000100:00100000:1.0:1789023677.662192:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007040384 00010000:00010000:1.0:1789023677.662231:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 46 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023677.662289:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:1.0:1789023677.662299:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:2361:x1875927007040384:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023677.662313:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023677.662331:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 46 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.662343:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 46 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.662365:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb34186c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb53 expref: 46 pid: 7654 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.662387:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023677.662392:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.662402:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.662409:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023677.662443:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023677.662547:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+45:2361:x1875927007040384:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 249us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023677.662566:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00010000:00010000:2.0:1789023677.662733:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662742:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023677.662785:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789023677.662796:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023677.662823:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662848:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662859:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662865:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662872:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662878:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023677.662882:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662889:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662898:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023677.662901:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023677.662904:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662909:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34186de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662921:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662935:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662941:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662946:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023677.662949:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662955:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662964:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65eea05300) 00010000:00010000:2.0:1789023677.662966:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023677.662970:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.662975:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb34186e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.663012:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb34186d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb5a expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.663027:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb5a expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.663034:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023677.663036:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023677.663044:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:2.0:1789023677.663068:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+44:11465:x1875927007040000:12345-192.168.203.48@tcp:101:stat.0 Request processed in 8282us (8485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023677.663075:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 155 00010000:00010000:2.0:1789023677.706629:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023677.734823:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023677.735391:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007040640 00000100:00100000:2.0:1789023677.735400:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007040640 00000100:00100000:2.0:1789023677.735504:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 156 00000100:00100000:2.0:1789023677.735512:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+44:11471:x1875927007040640:12345-192.168.203.48@tcp:36:truncate.0 00010000:00010000:2.0:1789023677.735563:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023677.735587:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34186ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb5a expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.735606:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023677.735610:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023677.735827:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.735842:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.735852:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789023677.736631:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:2.0:1789023677.736672:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f81735b5 reply state 0000000020ca4822 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023677.736694:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023677.737001:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:11471:x1875927007040640:12345-192.168.203.48@tcp:36:truncate.0 Request processed in 1486us (2185us total) trans 4294967445 rc 0/0 00000100:00100000:2.0:1789023677.737022:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 156 00000020:00080000:2.0:1789023677.737029:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789023677.739837:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.739854:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.739862:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.739868:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023677.739873:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.740065:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.740082:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:0.0:1789023677.740085:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023677.740090:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023677.740096:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023677.917747:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023677.917853:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007040768 00000100:00100000:2.0:1789023677.917863:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007040768 00000100:00100000:2.0:1789023677.917924:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 157 00000100:00100000:2.0:1789023677.917934:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+45:11485:x1875927007040768:12345-192.168.203.48@tcp:101:stat.0 00010000:00010000:2.0:1789023677.917958:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023677.917979:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb61 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918044:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918057:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918068:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918082:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918088:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918095:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918177:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918204:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918211:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023677.918258:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789023677.918263:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023677.918280:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918301:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918309:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918315:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918321:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918326:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023677.918330:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918336:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918347:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023677.918356:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023677.918362:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918369:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918382:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918387:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918393:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918398:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023677.918400:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918407:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918414:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023677.918417:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023677.918419:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918424:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918455:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34186fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 47 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918549:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 46 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023677.918556:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023677.918558:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023677.918561:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06000, rc 0) 00000100:00100000:2.0:1789023677.918627:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:11485:x1875927007040768:12345-192.168.203.48@tcp:101:stat.0 Request processed in 695us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023677.918640:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 157 00000100:00100000:2.0:1789023678.006436:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023678.010118:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007041024 00000100:00100000:3.0:1789023678.010135:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007041024 00000100:00100000:3.0:1789023678.010228:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 158 00000100:00100000:3.0:1789023678.010244:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+46:11495:x1875927007041024:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023678.010264:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023678.010285:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418716 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb68 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023678.010370:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789023678.010515:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418716 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb68 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.010530:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:3.0:1789023678.010533:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789023678.010540:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418716 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb68 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.010554:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d600, rc 0) 00000100:00100000:3.0:1789023678.010630:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:11495:x1875927007041024:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 392us (4203us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1789023678.010637:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 158 00000100:00080000:1.0:1789023678.012075:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023678.017418:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.018991:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007041280 00000100:00100000:1.0:1789023678.019004:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007041280 00000100:00100000:1.0:1789023678.019327:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:1.0:1789023678.019444:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+47:11495:x1875927007041280:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023678.019863:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9afa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+48:11495:x1875927007041280:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 424us (2454us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789023678.019871:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1789023678.104992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.105143:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007041536 00000100:00100000:2.0:1789023678.105153:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007041536 00000100:00100000:2.0:1789023678.105221:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:2.0:1789023678.105232:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+48:11501:x1875927007041536:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023678.105267:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.105288:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418724 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb6f expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.105401:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.105416:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 49 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.105424:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.105473:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 49 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.105526:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 49 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023678.105541:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e74bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024868352:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023678.105636:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c6b8d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789023678.114360:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e74bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024868352:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023678.114390:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023678.114435:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023678.114637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007041664 00000100:00100000:3.0:1789023678.114645:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007041664 00010000:00010000:3.0:1789023678.114695:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 50 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023678.114968:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:3.0:1789023678.114990:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+50:2362:x1875927007041664:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023678.115005:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023678.115012:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 50 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.115026:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 50 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.115047:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341870f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb61 expref: 50 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.115061:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:3.0:1789023678.115065:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.115075:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.115081:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.115113:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023678.115172:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:2362:x1875927007041664:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 183us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023678.115180:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00010000:00010000:1.0:1789023678.116270:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.116283:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023678.116304:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789023678.116459:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 50 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.116536:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 49 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.116545:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023678.116548:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789023678.116551:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06a00, rc 0) 00000100:00100000:1.0:1789023678.116605:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:11501:x1875927007041536:12345-192.168.203.48@tcp:101:bash.0 Request processed in 11374us (11625us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1789023678.116612:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 159 00000100:00100000:2.0:1789023678.120110:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023678.120193:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007041920 00000100:00100000:3.0:1789023678.120203:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007041920 00000100:00100000:3.0:1789023678.120355:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 160 00000100:00100000:3.0:1789023678.120367:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:11501:x1875927007041920:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:3.0:1789023678.121171:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.121190:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.121202:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023678.121368:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1789023678.121456:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b200aa65 reply state 000000009ff0959d transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023678.121467:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789023678.121989:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:11501:x1875927007041920:12345-192.168.203.48@tcp:36:bash.0 Request processed in 1623us (1884us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1789023678.121997:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 160 00000020:00080000:3.0:1789023678.122002:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789023678.124650:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.124662:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.124667:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.124698:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023678.124704:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.124780:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.124925:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:0.0:1789023678.124929:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023678.124935:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.124942:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418739 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023678.130773:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.130895:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007042048 00000100:00100000:1.0:1789023678.130918:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007042048 00000100:00100000:1.0:1789023678.130983:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:1.0:1789023678.130995:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:11501:x1875927007042048:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023678.131018:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023678.131039:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3418740 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb76 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.131117:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.131136:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 52 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.131145:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.131176:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 52 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.131190:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 52 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023678.131202:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024868480:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023678.132011:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1b11540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023678.134464:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024868480:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023678.135067:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.139210:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007042176 00000100:00100000:1.0:1789023678.139226:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007042176 00010000:00010000:1.0:1789023678.139284:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 53 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023678.139352:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:1.0:1789023678.139364:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:2361:x1875927007042176:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023678.139381:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023678.139389:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 53 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.139401:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 53 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.139422:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341872b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb6f expref: 53 pid: 7654 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.139439:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023678.139445:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.139454:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.139462:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.139741:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023678.139944:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.139956:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.139962:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023678.140004:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789023678.140008:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023678.140027:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.140061:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ee00/0xc3c1fcbfb3418740 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb76 expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.140097:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb76 expref: 52 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.140105:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023678.140108:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023678.140110:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023678.140212:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2666680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:2361:x1875927007042176:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 848us (5145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023678.140221:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:2.0:1789023678.148660:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:11501:x1875927007042048:12345-192.168.203.48@tcp:101:bash.0 Request processed in 17654us (17884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.148674:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 161 00000100:00100000:1.0:1789023678.149384:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.149466:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007042432 00000100:00100000:2.0:1789023678.149571:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007042432 00000100:00100000:2.0:1789023678.149660:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1789023678.149669:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:11501:x1875927007042432:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:2.0:1789023678.149909:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:11501:x1875927007042432:12345-192.168.203.48@tcp:35:bash.0 Request processed in 240us (526us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1789023678.149916:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:3.0:1789023678.261001:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.261116:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007042688 00000100:00100000:2.0:1789023678.261127:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007042688 00000100:00100000:2.0:1789023678.261193:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:2.0:1789023678.261203:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:11511:x1875927007042688:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023678.261227:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.261246:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341874e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb7d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023678.261329:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789023678.261474:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341874e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb7d expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.261760:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:2.0:1789023678.261764:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023678.261770:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341874e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb7d expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.261785:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06c00, rc 0) 00000100:00100000:2.0:1789023678.262084:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11511:x1875927007042688:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 880us (1089us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1789023678.262091:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 162 00000100:00100000:3.0:1789023678.275015:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.275915:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007042816 00000100:00100000:1.0:1789023678.275928:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007042816 00000100:00100000:1.0:1789023678.275994:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:1.0:1789023678.276004:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11511:x1875927007042816:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:1.0:1789023678.276077:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276092:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276102:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276115:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276123:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276129:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276205:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276212:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276219:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023678.276267:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276415:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276422:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276429:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276434:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023678.276438:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276445:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276457:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023678.276460:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023678.276465:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276470:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb341875c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276517:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276524:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276529:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276543:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023678.276546:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276552:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276561:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65eea05000) 00010000:00010000:1.0:1789023678.276564:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023678.276567:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276572:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418763 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276587:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276592:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276597:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276602:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023678.276605:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276611:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276629:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:1.0:1789023678.276631:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023678.276635:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.276641:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb341876a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023678.276735:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11511:x1875927007042816:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 731us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023678.276742:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 163 00000100:00100000:1.0:1789023678.283866:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.284294:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007043072 00000100:00100000:2.0:1789023678.284304:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007043072 00000100:00100000:2.0:1789023678.284357:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:2.0:1789023678.284367:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11511:x1875927007043072:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023678.284630:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:11511:x1875927007043072:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 263us (772us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1789023678.284638:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:3.0:1789023678.332863:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.333081:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007043328 00000100:00100000:2.0:1789023678.333091:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007043328 00000100:00100000:2.0:1789023678.333152:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:2.0:1789023678.333285:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+54:11514:x1875927007043328:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023678.333307:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.333326:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418771 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb84 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333413:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333428:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333440:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333453:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333460:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333467:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333608:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418786 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333617:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333624:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418786 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023678.333633:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789023678.333734:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333742:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333757:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333763:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.333767:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333775:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333787:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023678.333790:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023678.333805:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333812:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418778 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333825:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333831:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333836:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333841:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.333844:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333860:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.333868:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023678.333871:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023678.333874:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.334607:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb341877f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.334666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418771 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb84 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.334691:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418786 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb84 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.334700:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023678.334702:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023678.334705:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06000, rc 0) 00000100:00100000:2.0:1789023678.334778:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:11514:x1875927007043328:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1618us (1925us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1789023678.334786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 164 00000100:00100000:1.0:1789023678.342747:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.342790:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.342839:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007043456 00000100:00100000:2.0:1789023678.342850:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007043456 00000100:00100000:2.0:1789023678.342913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 165 00000100:00100000:2.0:1789023678.342923:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:11514:x1875927007043456:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1789023678.343000:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343017:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343028:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343052:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343059:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343066:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343071:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.343076:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343083:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343095:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023678.343098:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023678.343103:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.343109:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023678.343110:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007043584 00000100:00100000:0.0:1789023678.343116:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007043584 00000100:00100000:0.0:1789023678.343169:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1789023678.343179:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:2364:x1875927007043584:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023678.343191:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789023678.343194:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11514:x1875927007043456:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 270us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.343203:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 165 00010000:00010000:0.0:1789023678.343211:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418786 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb84 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.343225:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:0.0:1789023678.343228:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023678.343743:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:2364:x1875927007043584:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 564us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023678.343751:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789023678.345855:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.346006:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007043840 00000100:00100000:2.0:1789023678.346016:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007043840 00000100:00100000:2.0:1789023678.346062:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:2.0:1789023678.346069:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:11514:x1875927007043840:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023678.346291:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:11514:x1875927007043840:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 222us (445us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1789023678.346299:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:1.0:1789023678.517943:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023678.518857:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007044096 00000100:00100000:0.0:1789023678.518871:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007044096 00000100:00100000:0.0:1789023678.518995:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:0.0:1789023678.519007:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65de0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:11533:x1875927007044096:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:0.0:1789023678.519032:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023678.519052:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341879b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb8b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.519146:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34187a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.519160:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34187a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.519185:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34187a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023678.519197:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789023678.519399:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb341879b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb8b expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.519420:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34187a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb8b expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.519428:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:0.0:1789023678.519431:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789023678.519435:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05000, rc 0) 00000100:00100000:0.0:1789023678.519569:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65de0fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11533:x1875927007044096:12345-192.168.203.48@tcp:101:cat.0 Request processed in 564us (1635us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1789023678.519591:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 166 00000100:00100000:3.0:1789023678.552269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.552934:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007044224 00000100:00100000:2.0:1789023678.552948:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007044224 00000100:00100000:2.0:1789023678.553028:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:2.0:1789023678.553042:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11534:x1875927007044224:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023678.553071:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.553098:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb92 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.553201:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34187b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.553216:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34187b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.553228:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34187b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023678.553336:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789023678.553340:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023678.553369:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34187b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.553396:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb92 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.553416:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34187b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb92 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.553424:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023678.553427:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023678.553431:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06a00, rc 0) 00000100:00100000:2.0:1789023678.553722:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11534:x1875927007044224:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 682us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.553731:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 167 00000100:00100000:3.0:1789023678.564371:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.564666:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007044608 00000100:00100000:2.0:1789023678.564894:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007044608 00000100:00100000:2.0:1789023678.565065:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:2.0:1789023678.565076:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11534:x1875927007044608:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:2.0:1789023678.567451:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11534:x1875927007044608:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 2368us (3081us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789023678.567463:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1789023678.573013:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.573174:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007044736 00000100:00100000:2.0:1789023678.573185:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007044736 00000100:00100000:2.0:1789023678.573381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789023678.573391:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11534:x1875927007044736:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:2.0:1789023678.573407:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789023678.573429:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418747 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb76 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.573456:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34187a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb8b expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.573471:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418652 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb37 expref: 58 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.573898:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023678.573910:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023678.574036:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11534:x1875927007044736:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 645us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.574044:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:3.0:1789023678.576601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.576703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007044864 00000100:00100000:2.0:1789023678.576726:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007044864 00000100:00100000:2.0:1789023678.576773:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:2.0:1789023678.576782:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11534:x1875927007044864:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:2.0:1789023678.576883:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.576899:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.576911:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023678.577111:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789023678.577194:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11534:x1875927007044864:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 411us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.577202:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 168 00000100:00100000:3.0:1789023678.608567:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.609421:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007044992 00000100:00100000:1.0:1789023678.609433:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007044992 00000100:00100000:2.0:1789023678.609812:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 169 00000100:00100000:2.0:1789023678.609826:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11536:x1875927007044992:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023678.609847:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.609869:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34187c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfb99 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.609932:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.609947:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.612825:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.612856:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.612868:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.612875:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.612983:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613009:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613016:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023678.613055:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789023678.613059:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023678.613077:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613087:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613096:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613103:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613110:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613116:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.613120:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613128:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613138:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023678.613141:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023678.613152:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613159:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613177:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613183:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613188:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613193:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.613195:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613200:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613208:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023678.613210:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023678.613213:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613218:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34187d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613267:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34187c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613295:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.613302:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023678.613305:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023678.613307:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06e00, rc 0) 00000100:00100000:2.0:1789023678.613382:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11536:x1875927007044992:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3559us (4822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.613391:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 169 00010000:00010000:2.0:1789023678.729845:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789023678.859557:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023678.859567:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789023678.859654:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1789023678.859662:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789023678.859806:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024868608:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789023678.860081:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c637b300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023678.867833:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024868608:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789023678.871744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023678.871818:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007045120 00000100:00100000:0.0:1789023678.871827:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007045120 00000100:00100000:0.0:1789023678.871873:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:0.0:1789023678.871882:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11547:x1875927007045120:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789023678.871912:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789023678.872017:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11547:x1875927007045120:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 135us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023678.872026:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 170 00000100:00100000:1.0:1789023678.878071:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023678.878152:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007045248 00000100:00100000:3.0:1789023678.878171:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007045248 00000100:00100000:3.0:1789023678.878244:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:3.0:1789023678.878269:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11547:x1875927007045248:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789023678.878339:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878366:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878383:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878398:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878411:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878418:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878450:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878465:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878473:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023678.878582:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789023678.878592:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023678.878605:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878632:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878644:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878652:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878658:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023678.878663:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878671:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878693:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:3.0:1789023678.878695:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023678.878700:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878706:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb34187e1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878718:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878723:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878729:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878740:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023678.878744:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878751:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878759:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e65c6960900) 00010000:00010000:3.0:1789023678.878761:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023678.878764:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878771:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34187e8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878786:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878792:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878798:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878804:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023678.878808:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878815:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878843:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:3.0:1789023678.878846:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023678.878849:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.878856:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34187ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023678.880595:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11547:x1875927007045248:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 2315us (2519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023678.880608:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 171 00000100:00100000:1.0:1789023678.883554:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.883707:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007045504 00000100:00100000:2.0:1789023678.883716:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007045504 00000100:00100000:2.0:1789023678.883780:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:2.0:1789023678.883794:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11547:x1875927007045504:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023678.883814:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.883834:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187f6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfba0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.883952:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.883971:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884001:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023678.884014:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789023678.884116:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884124:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884130:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884137:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.884142:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884150:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884162:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023678.884165:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023678.884169:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884176:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34187fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884221:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187f6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfba0 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884244:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:2.0:1789023678.884247:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023678.884252:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34187f6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfba0 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.884265:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023678.884331:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11547:x1875927007045504:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 540us (783us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1789023678.884340:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 172 00000100:00100000:2.0:1789023678.890975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023678.891050:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007045632 00000100:00100000:3.0:1789023678.891060:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007045632 00000100:00100000:3.0:1789023678.891110:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:3.0:1789023678.891119:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11547:x1875927007045632:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789023678.891150:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789023678.891554:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11547:x1875927007045632:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 426us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023678.891562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 173 00000100:00100000:2.0:1789023678.896415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023678.896625:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007045888 00000100:00100000:0.0:1789023678.896635:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007045888 00000100:00100000:0.0:1789023678.896724:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:0.0:1789023678.896734:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11547:x1875927007045888:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023678.896756:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023678.896759:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789023678.896782:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34187b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb92 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.896801:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023678.896811:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023678.896825:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341880b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfba7 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789023678.897397:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1789023678.897823:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418812 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.902777:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023678.902802:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418812 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.903345:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb341880b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfba7 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.903369:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418812 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfba7 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.903379:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65c8ebd600) 00010000:00010000:1.0:1789023678.903382:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023678.903399:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05800, rc 0) 00000100:00100000:1.0:1789023678.903575:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11547:x1875927007045888:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 6842us (7168us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1789023678.903585:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 174 00000100:00100000:0.0:1789023678.909604:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.909776:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007046144 00000100:00100000:2.0:1789023678.909787:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007046144 00000100:00100000:2.0:1789023678.909842:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:2.0:1789023678.909853:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11547:x1875927007046144:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789023678.909907:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023678.909933:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418812 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfba7 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.909953:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65c8ebd600) 00010000:00010000:2.0:1789023678.909964:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023678.909986:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.909998:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910027:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910043:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910051:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910058:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910118:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910125:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910132:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910138:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.910142:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910150:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910170:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023678.910173:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023678.910176:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910189:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418820 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910200:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910206:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910211:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910216:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023678.910219:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910225:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910233:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x645d7944 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023678.910236:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023678.910239:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.910244:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418827 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x645d7944 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023678.910435:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11547:x1875927007046144:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 582us (838us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023678.910443:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 175 00000100:00100000:2.0:1789023678.919287:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.919945:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007046272 00000100:00100000:1.0:1789023678.919956:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007046272 00000100:00100000:1.0:1789023678.920017:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00100000:1.0:1789023678.920028:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11547:x1875927007046272:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023678.920047:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023678.920068:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341882e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbae expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.920102:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.920115:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.920125:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.920223:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb341882e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.920247:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023678.920256:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:1.0:1789023678.920259:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789023678.920270:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e000, rc 0) 00000100:00100000:1.0:1789023678.920380:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11547:x1875927007046272:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 354us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023678.920387:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 176 00000100:00100000:1.0:1789023678.935057:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.935241:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007046528 00000100:00100000:2.0:1789023678.935255:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007046528 00000100:00100000:2.0:1789023678.935321:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 177 00000100:00100000:2.0:1789023678.935336:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11547:x1875927007046528:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789023678.935419:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.935436:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.935449:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023678.935772:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789023678.935787:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345006308787ns, next at 346006305934ns, rc = 0 00000004:00010000:2.0:1789023678.935882:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002752fd12 reply state 0000000088da54ab transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023678.935892:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023678.935993:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11547:x1875927007046528:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 659us (942us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789023678.936001:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 177 00010000:00010000:3.0:1789023678.939164:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.939181:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.939197:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.939220:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023678.939225:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.939233:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.939249:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:3.0:1789023678.939253:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789023678.939257:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.939263:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb341883c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023678.939947:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023678.940243:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007046656 00000100:00100000:3.0:1789023678.940253:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007046656 00000100:00100000:3.0:1789023678.940311:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 178 00000100:00100000:3.0:1789023678.940321:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11547:x1875927007046656:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023678.940342:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023678.940361:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbb5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.940416:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.940430:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023678.940468:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:3.0:1789023678.940471:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789023678.940474:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d600, rc 0) 00000100:00100000:3.0:1789023678.940551:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11547:x1875927007046656:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 232us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023678.940558:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 178 00000100:00100000:1.0:1789023678.948702:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.954533:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007046784 00000100:00100000:2.0:1789023678.954559:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007046784 00000100:00100000:2.0:1789023678.954635:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:2.0:1789023678.954646:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007046784:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789023678.954981:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007046784:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 336us (6288us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789023678.955014:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00080000:1.0:1789023678.955532:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789023678.961730:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.961836:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007047040 00000100:00100000:1.0:1789023678.961846:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007047040 00000100:00100000:1.0:1789023678.961889:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:1.0:1789023678.961898:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11547:x1875927007047040:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789023678.962125:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11547:x1875927007047040:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 228us (404us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789023678.962134:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:2.0:1789023678.968934:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.969012:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007047296 00000100:00100000:1.0:1789023678.969023:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007047296 00000100:00100000:1.0:1789023678.969078:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:1.0:1789023678.969088:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11547:x1875927007047296:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789023678.969201:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11547:x1875927007047296:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 102us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023678.969208:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 179 00000100:00100000:3.0:1789023678.982123:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023678.984890:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007047424 00000100:00100000:1.0:1789023678.984905:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007047424 00000100:00100000:2.0:1789023678.985351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:2.0:1789023678.985364:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11547:x1875927007047424:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023678.985385:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.985407:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341884a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbbc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.985495:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.985510:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.985523:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023678.985562:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023678.985581:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.985707:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341884a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbbc expref: 65 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.985728:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbbc expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.985754:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:2.0:1789023678.985757:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789023678.985761:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023678.985819:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+64:11547:x1875927007047424:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 458us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.985825:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 180 00000100:00100000:1.0:1789023678.996908:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023678.997924:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007047552 00000100:00100000:2.0:1789023678.997935:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007047552 00000100:00100000:2.0:1789023678.997983:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:2.0:1789023678.997993:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2364:x1875927007047552:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023678.998010:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023678.998028:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbc3 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789023678.998056:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa255be, blocks: 0x1 00010000:00010000:2.0:1789023678.998074:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1789023678.998079:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023678.998087:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.998106:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023678.998118:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023678.998174:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2364:x1875927007047552:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 182us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023678.998181:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:2.0:1789023679.005330:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.005364:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007047808 00000100:00100000:2.0:1789023679.005373:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007047808 00000100:00100000:2.0:1789023679.005416:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:2.0:1789023679.005425:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+64:11547:x1875927007047808:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789023679.005537:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+64:11547:x1875927007047808:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 113us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.005544:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 181 00000100:00100000:0.0:1789023679.008460:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.008508:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007047936 00000100:00100000:0.0:1789023679.008517:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007047936 00000100:00100000:0.0:1789023679.009535:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:0.0:1789023679.009562:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:11547:x1875927007047936:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023679.009581:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023679.009598:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbca expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.010335:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.010349:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023679.010354:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023679.010368:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.010406:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 9 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.010421:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 9 pid: 6695 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.010435:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024868736:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023679.010554:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023679.016056:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024868736:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023679.016099:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 9 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.016125:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04400, rc 0) 00000100:00100000:2.0:1789023679.016180:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:11547:x1875927007047936:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 6634us (7728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.016263:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1789023679.018983:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023679.020054:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007048064 00000100:00100000:1.0:1789023679.020067:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007048064 00010000:00010000:1.0:1789023679.020117:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 9 pid: 6695 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023679.020162:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:1.0:1789023679.020172:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c2f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007048064:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023679.020186:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023679.020207:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 9 pid: 6695 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.020221:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 9 pid: 6695 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.020243:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418858 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbc3 expref: 9 pid: 6695 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.020258:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023679.020262:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023679.020270:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.020280:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.020317:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023679.020342:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875927024868864:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789023679.020422:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d237c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023679.030717:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.030777:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5830:1875927024868864:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789023679.030802:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023679.030852:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c2f85c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007048064:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 10681us (11878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023679.030863:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:0.0:1789023679.030907:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007048192 00000100:00100000:0.0:1789023679.030915:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007048192 00002000:00100000:0.0:1789023679.030970:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e65d2664700 x1875927007048192/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:605/0 lens 504/0 e 0 to 0 dl 1789023690 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023679.030981:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65d2664700 with x1875927007048192 ext(0->8) 00002000:00010000:0.0:1789023679.030986:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65d2664700 00000100:00100000:0.0:1789023679.031009:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1789023679.031019:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007048192:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789023679.031515:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2361:x1875927007048192:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 495us (804us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789023679.031524:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00002000:00100000:0.0:1789023679.031531:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e65d2664700 x1875927007048192/t4294967314(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:605/0 lens 504/448 e 0 to 0 dl 1789023690 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023679.031540:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65d2664700 with x1875927007048192 ext(0->8) 00002000:00010000:0.0:1789023679.031561:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65d2664700 00000001:00080000:1.0:1789023679.049253:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:1.0:1789023679.050855:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1789023679.050870:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1789023679.053137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.053992:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007048320 00000100:00100000:3.0:1789023679.054003:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007048320 00000100:00100000:3.0:1789023679.054055:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:3.0:1789023679.054066:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+64:11547:x1875927007048320:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789023679.054191:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+64:11547:x1875927007048320:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 126us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023679.054199:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 182 00000100:00100000:3.0:1789023679.057549:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.057925:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007048448 00000100:00100000:2.0:1789023679.057936:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007048448 00000100:00100000:2.0:1789023679.057991:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:2.0:1789023679.058002:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2362:x1875927007048448:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789023679.099623:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:0.0:1789023679.100370:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1789023679.100383:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789023679.100400:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e64c252b300 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789023679.100405:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65c84f5600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e65d8d1dd80 00000020:00080000:0.0:1789023679.100408:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65c84f5e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65f6f05c00 00000004:00080000:0.0:1789023679.100423:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789023679.100558:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1789023679.100756:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1789023679.100950:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024868992:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789023679.101011:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023679.101457:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024868992 00000100:00100000:2.0:1789023679.101466:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024868992 00000100:00100000:0.0:1789023679.101474:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789023679.101505:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024869120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789023679.101538:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023679.101545:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789023679.101557:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024868992:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789023679.101578:0:7164:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00002000:00080000:2.0:1789023679.101582:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00000100:00100000:0.0:1789023679.101587:0:7164:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00002000:00010000:2.0:1789023679.101618:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa255bc, atime: 0x6aa255bc, ctime: 0x6aa255bc, blocks: 0xb 00010000:00010000:2.0:1789023679.101627:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.101644:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1789023679.101649:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023679.101655:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.101682:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.101692:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.101700:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.101717:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789023679.102563:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789023679.102564:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875927024868992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1007us (1550us total) trans 4294967307 rc 0/0 00010000:00010000:0.0:1789023679.102574:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.102593:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc17718b0) 00000100:00100000:2.0:1789023679.102597:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:0.0:1789023679.102600:0:7644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.102611:0:7644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.102622:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024869120 00000100:00100000:2.0:1789023679.102628:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024869120 00010000:00010000:0.0:1789023679.102630:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.102652:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789023679.102660:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024869120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789023679.102771:0:3312:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:1.0:1789023679.102778:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:1.0:1789023679.102800:0:3312:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8e65f78c6a00 x1875927024868992/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789023695 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789023679.102812:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65f78c6a00/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789023679.102816:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024868992:0@lo:6:osp-syn-1-0.0 00002000:00010000:2.0:1789023679.102909:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789023679.102914:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789023678 00002000:00010000:2.0:1789023679.102917:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789023679.102919:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789023678 -> 1789023678 00002000:00010000:2.0:1789023679.102922:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789023679.102967:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875927024869120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 307us (1429us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789023679.102975:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789023679.102998:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789023679.103003:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789023679.103109:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ebb2409/0xc3c1fcbfb3418866 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.103131:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023679.103133:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023679.103135:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789023679.103352:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65f78c4700/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789023679.103358:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024869120:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789023679.113972:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:0.0:1789023679.114120:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007048448:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 56114us (56575us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023679.114132:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:3.0:1789023679.121046:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.121203:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007048704 00000100:00100000:2.0:1789023679.121214:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007048704 00000100:00100000:2.0:1789023679.121268:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 183 00000100:00100000:2.0:1789023679.121278:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:11547:x1875927007048704:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789023679.121328:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023679.121353:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbbc expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.121370:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:2.0:1789023679.121376:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023679.121405:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.121425:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.121435:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023679.121706:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008153170f reply state 0000000000e1f5ab transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.121717:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023679.121805:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11547:x1875927007048704:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 527us (766us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789023679.121812:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 183 00010000:00010000:3.0:1789023679.125956:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.125971:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.125980:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.125987:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023679.125992:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.126000:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.126015:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:3.0:1789023679.126018:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023679.126023:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.126029:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb341886d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.130216:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.130321:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007048832 00000100:00100000:3.0:1789023679.130331:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007048832 00000100:00100000:3.0:1789023679.130497:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789023679.130509:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007048832:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789023679.130714:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789023679.130718:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789023678 -> 1789023677 00002000:00010000:3.0:1789023679.130721:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789023676 00002000:00010000:3.0:1789023679.130729:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789023678 -> 1789023677 00002000:00010000:3.0:1789023679.130732:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789023679.130790:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007048832:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 283us (658us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789023679.130797:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789023679.133943:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.135182:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007049088 00000100:00100000:0.0:1789023679.135192:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007049088 00000100:00100000:0.0:1789023679.135271:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 184 00000100:00100000:0.0:1789023679.135282:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:11547:x1875927007049088:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789023679.135345:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.135362:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.135371:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.135405:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.135425:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 18 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.135447:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024869248:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023679.135555:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73246c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023679.139719:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023679.139866:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007049216 00000100:00100000:1.0:1789023679.139876:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007049216 00000100:00100000:0.0:1789023679.139891:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5846:1875927024869248:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023679.139913:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.139916:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.139946:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1789023679.139955:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:2361:x1875927007049216:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023679.139968:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023679.139975:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.139986:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.140008:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e000/0xc3c1fcbfb3418835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbae expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.140025:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:0.0:1789023679.140030:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.140039:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.140047:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.140080:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023679.140127:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2665180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:2361:x1875927007049216:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 174us (417us total) trans 0 rc 0/0 00010000:00010000:3.0:1789023679.140178:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140185:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140211:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140219:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140226:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140242:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023679.140247:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140254:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140264:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:3.0:1789023679.140267:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789023679.140277:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.140284:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb3418874 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023679.140324:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:11547:x1875927007049088:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 5044us (6390us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789023679.140332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 184 00000100:00100000:0.0:1789023679.143018:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:3.0:1789023679.145724:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.145939:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007049344 00000100:00100000:0.0:1789023679.145949:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007049344 00000100:00100000:0.0:1789023679.145997:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789023679.146007:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007049344:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789023679.146049:0:7164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.146067:0:7164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.146076:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023679.146080:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023679.146084:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.146117:0:7164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.146130:0:7164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 8 pid: 6696 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.146158:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024869376:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023679.146249:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e73246c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023679.149024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.149202:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007049472 00000100:00100000:3.0:1789023679.149212:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007049472 00010000:00010000:3.0:1789023679.149247:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 9 pid: 6696 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023679.149283:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024869376:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023679.149311:0:7164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023679.149353:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:3.0:1789023679.149364:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007049472:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023679.149379:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023679.149399:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 9 pid: 6696 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.149411:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 9 pid: 6696 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.149433:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088700b9a/0xc3c1fcbfb341885f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbca expref: 9 pid: 6696 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.149448:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789023679.149461:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789023679.149467:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.149494:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.149525:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023679.149573:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007049472:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 212us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023679.149581:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00010000:00010000:1.0:1789023679.149633:0:7164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149668:0:7164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149704:0:7164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149721:0:7164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149730:0:7164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149737:0:7164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023679.149741:0:7164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149912:0:7164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149928:0:7164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.149936:0:7164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb341887b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023679.150001:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007049344:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 3995us (4287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023679.150008:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:2.0:1789023679.155294:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.155409:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007049728 00000100:00100000:3.0:1789023679.155419:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007049728 00000100:00100000:3.0:1789023679.155471:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 185 00000100:00100000:3.0:1789023679.155503:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+17:11547:x1875927007049728:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789023679.155577:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.155593:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.155605:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.155844:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.155855:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.155876:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.155908:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.155923:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 18 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023679.155936:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2664000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024869504:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023679.156036:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d8e78b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789023679.159187:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2664000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024869504:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023679.159216:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.168886:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.170396:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007049856 00000100:00100000:3.0:1789023679.170411:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007049856 00010000:00010000:2.0:1789023679.170576:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.170652:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:2.0:1789023679.170663:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:2362:x1875927007049856:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023679.170687:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023679.170695:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.170731:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.170755:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb3418843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbb5 expref: 19 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.170768:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:2.0:1789023679.170773:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.170782:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.170790:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.170814:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023679.170878:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76f8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+18:2362:x1875927007049856:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 218us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.170886:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00010000:00010000:3.0:1789023679.174700:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.175034:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023679.175230:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789023679.175452:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789023679.175526:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789023679.175613:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2664000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024869632:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789023679.176558:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023679.176598:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f40b26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023679.176719:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024869632 00000100:00100000:1.0:1789023679.176728:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024869632 00000100:00100000:1.0:1789023679.176787:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023679.176797:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875927024869632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789023679.176871:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875927024869632:12345-0@lo:1000:mdt00_000.0 Request processed in 76us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023679.176878:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789023679.177226:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2664000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024869632:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789023679.177962:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789023679.178046:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2664000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024869760:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789023679.178101:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023679.178175:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f40b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1789023679.180240:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024869760 00000100:00100000:1.0:1789023679.180252:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024869760 00000100:00100000:0.0:1789023679.180535:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789023679.180555:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875927024869760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789023679.180826:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1875927024869760:12345-0@lo:1000:mdt00_000.0 Request processed in 281us (2725us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789023679.180835:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789023679.180911:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2664000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5845:1875927024869760:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789023679.181119:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181130:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181138:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181149:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023679.181153:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181160:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181174:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05000) 00010000:00010000:2.0:1789023679.181177:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023679.181181:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181187:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3418889 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181215:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181222:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181227:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181232:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023679.181234:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181240:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181258:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023679.181260:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023679.181263:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181269:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34187be lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181304:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181318:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181327:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181369:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.181384:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 21 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.181397:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c247b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024869888:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023679.181464:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1600 going to sleep for 11 seconds 00000100:00100000:3.0:1789023679.190345:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c247b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024869888:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023679.190375:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.191711:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.191745:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007049984 00000100:00100000:0.0:1789023679.191753:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007049984 00010000:00010000:0.0:1789023679.191785:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 22 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.191819:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:0.0:1789023679.191828:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:2361:x1875927007049984:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023679.191841:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023679.191849:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 22 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.191862:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 22 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.191883:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34187da lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfb99 expref: 22 pid: 5845 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.191896:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023679.191901:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.191918:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.191925:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.191949:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023679.191995:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:2361:x1875927007049984:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 167us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023679.192002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00010000:00010000:0.0:1789023679.192030:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192038:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192050:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192057:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192063:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192069:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.192073:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192081:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192096:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023679.192099:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.192103:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192110:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418890 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192122:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192128:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192851:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192857:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.192860:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192868:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192879:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023679.192882:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789023679.192885:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.192891:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb3418882 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.193109:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11547:x1875927007049728:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 37607us (37830us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1789023679.193118:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 185 00000020:00080000:0.0:1789023679.193123:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789023679.193265:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023679.193270:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023679.193790:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789023679.193799:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789023679.200271:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023679.200347:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007050240 00000100:00100000:1.0:1789023679.200357:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007050240 00000100:00100000:1.0:1789023679.200421:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:1.0:1789023679.200430:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11547:x1875927007050240:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789023679.201114:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789023679.201235:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1789023679.201283:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.201299:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.201312:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.201331:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.201338:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.201345:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.201369:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789023679.201473:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9af9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:11547:x1875927007050240:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1043us (1211us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1789023679.201503:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000020:00080000:1.0:1789023679.201508:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789023679.201525:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023679.201532:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.201538:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023679.201542:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.201549:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.201561:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e65eea05300) 00010000:00010000:3.0:1789023679.201564:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789023679.201570:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.201576:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f800/0xc3c1fcbfb3418897 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.201596:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023679.201598:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023679.201599:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789023679.439306:0:12482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789023679.439315:0:12482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789023679.439373:0:12482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1789023679.439379:0:12482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789023679.476170:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.476264:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.476291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.476316:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.476336:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.476374:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007050880 00000100:00100000:2.0:1789023679.476384:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007050880 00000100:00100000:2.0:1789023679.476439:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007050496 00000100:00100000:2.0:1789023679.476442:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007050496 00000100:00100000:2.0:1789023679.476464:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:2.0:1789023679.476474:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007050880:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023679.476585:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2361:x1875927007050880:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.476593:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 140 00000100:00100000:2.0:1789023679.476611:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:2.0:1789023679.476618:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:2361:x1875927007050496:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023679.476649:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:2361:x1875927007050496:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.476655:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 141 00000100:00100000:2.0:1789023679.476690:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007050624 00000100:00100000:2.0:1789023679.476694:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007050624 00000100:00100000:2.0:1789023679.476728:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007050752 00000100:00100000:2.0:1789023679.476731:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007050752 00000100:00100000:2.0:1789023679.476751:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:2.0:1789023679.476758:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007050624:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023679.476785:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2478380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007050624:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.476808:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:2.0:1789023679.476820:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:2.0:1789023679.476826:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927007050752:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023679.476851:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2361:x1875927007050752:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.476857:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00080000:2.0:1789023679.476872:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023679.476877:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023679.480971:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007050368 00000100:00100000:1.0:1789023679.480986:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007050368 00000100:00100000:1.0:1789023679.481515:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 288 00000100:00100000:1.0:1789023679.481529:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007050368:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023679.481682:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0930450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007050368:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 148us (5974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023679.481689:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 288 00000100:00100000:3.0:1789023679.498399:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023679.498423:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f78c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024870016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023679.498513:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023679.498615:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024870016 00000100:00100000:0.0:1789023679.498634:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024870016 00000100:00100000:0.0:1789023679.498692:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789023679.498701:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024870016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023679.498723:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789023679.498781:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024870016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023679.498788:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789023679.498821:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f78c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024870016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789023679.659398:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023679.659508:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007051136 00000100:00100000:1.0:1789023679.659518:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007051136 00000100:00100000:1.0:1789023679.659589:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:1.0:1789023679.659601:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:11557:x1875927007051136:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023679.659645:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023679.659663:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb341889e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbd1 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.659769:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34188a5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.659788:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34188a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.659802:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34188a5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023679.659813:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789023679.659941:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e200/0xc3c1fcbfb341889e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd1 expref: 25 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.659962:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34188a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd1 expref: 24 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.659971:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023679.659974:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789023679.659978:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fe00, rc 0) 00000100:00100000:1.0:1789023679.664254:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:11557:x1875927007051136:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 4642us (4851us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1789023679.664267:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 186 00000100:00100000:2.0:1789023679.674037:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.674114:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007051264 00000100:00100000:0.0:1789023679.674124:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007051264 00000100:00100000:0.0:1789023679.674188:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:0.0:1789023679.674201:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:11557:x1875927007051264:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:0.0:1789023679.674288:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674306:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674319:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674356:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674364:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674371:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674726:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674736:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674744:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789023679.674783:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674796:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674803:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674811:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674817:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.674821:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674837:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674850:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023679.674854:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.674859:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674877:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674890:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674895:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674901:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674906:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.674909:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674914:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674922:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65c8ebd300) 00010000:00010000:0.0:1789023679.674924:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.674927:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674946:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674966:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674972:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674978:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674983:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.674986:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.674993:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.675000:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65c8ebd900) 00010000:00010000:0.0:1789023679.675003:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.675005:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.675010:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.675094:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2479f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:11557:x1875927007051264:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 895us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023679.675104:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 187 00000100:00100000:2.0:1789023679.725966:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.726117:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007051520 00000100:00100000:0.0:1789023679.726126:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007051520 00000100:00100000:0.0:1789023679.726182:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:0.0:1789023679.726192:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:11560:x1875927007051520:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023679.726212:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023679.726539:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbd8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.726614:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.726638:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.726650:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.726666:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.726682:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.726688:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.727532:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.727544:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.727553:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023679.727825:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789023679.728063:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728071:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728078:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728420:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023679.728428:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728438:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728452:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023679.728455:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023679.728460:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728466:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb34188cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728745:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728752:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728758:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728764:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023679.728767:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728773:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728795:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65c8ebd900) 00010000:00010000:2.0:1789023679.728798:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023679.728802:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728808:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb34188d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.728858:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb34188c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 27 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.729217:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 26 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.730535:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023679.730539:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023679.730543:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07400, rc 0) 00000100:00100000:2.0:1789023679.730630:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:11560:x1875927007051520:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 4435us (4667us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1789023679.730710:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 188 00000100:00100000:1.0:1789023679.737818:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.737964:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007051648 00000100:00100000:0.0:1789023679.737976:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007051648 00000100:00100000:0.0:1789023679.738036:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:0.0:1789023679.738046:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:11560:x1875927007051648:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1789023679.738192:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738223:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738351:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738379:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738387:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738394:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738400:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.738404:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738412:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738423:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023679.738426:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789023679.738431:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.738436:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb34188eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.738605:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:11560:x1875927007051648:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 559us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023679.738630:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 189 00000100:00100000:0.0:1789023679.746085:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.746359:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007051904 00000100:00100000:3.0:1789023679.746368:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007051904 00000100:00100000:3.0:1789023679.746422:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:3.0:1789023679.746430:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+26:11560:x1875927007051904:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:3.0:1789023679.746779:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:11560:x1875927007051904:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 348us (701us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789023679.746787:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00010000:00010000:2.0:1789023679.753659:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023679.794302:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023679.794378:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007052160 00000100:00100000:1.0:1789023679.794389:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007052160 00000100:00100000:1.0:1789023679.794461:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:1.0:1789023679.794471:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:11094:x1875927007052160:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023679.794522:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023679.794543:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34188f2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbdf expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.794654:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.794680:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.794689:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.794723:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023679.794737:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 28 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023679.794750:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024870144:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023679.794841:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023679.801455:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023679.801562:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007052288 00000100:00100000:3.0:1789023679.801571:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007052288 00010000:00010000:3.0:1789023679.801608:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 29 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023679.801653:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:3.0:1789023679.801663:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:2361:x1875927007052288:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023679.801687:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023679.801695:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 29 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.801707:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 29 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.801748:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023679.801754:0:6710:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.801765:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.801772:0:6710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023679.801792:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023679.801862:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:2361:x1875927007052288:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 200us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023679.801869:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00010000:00010000:2.0:1789023679.802074:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34188dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd8 expref: 28 pid: 5846 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.802094:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024870144:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023679.802113:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.802132:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.802140:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023679.802156:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789023679.802309:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb34188f2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.802329:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.802337:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023679.802340:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789023679.802343:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f600, rc 0) 00000100:00100000:2.0:1789023679.802368:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+28:11094:x1875927007052160:12345-192.168.203.48@tcp:101:bash.0 Request processed in 7899us (8077us total) trans 4294967473 rc 0/0 00000100:00100000:2.0:1789023679.802376:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 190 00000100:00100000:0.0:1789023679.806939:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.807009:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007052544 00000100:00100000:2.0:1789023679.807019:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007052544 00000100:00100000:2.0:1789023679.807080:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 191 00000100:00100000:2.0:1789023679.807092:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+28:11094:x1875927007052544:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:2.0:1789023679.808348:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.808371:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.808397:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789023679.808458:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1789023679.808518:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041009925 reply state 000000006946ba0f transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023679.808527:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789023679.808593:0:7654:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1789023679.808720:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11094:x1875927007052544:12345-192.168.203.48@tcp:36:bash.0 Request processed in 1629us (1788us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1789023679.808728:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 191 00000020:00080000:2.0:1789023679.808734:0:7654:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1789023679.812510:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.812528:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.812536:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.812603:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.812608:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.812616:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.812632:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023679.812635:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.812639:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.812646:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418907 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.813802:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.814620:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007052672 00000100:00100000:2.0:1789023679.814630:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007052672 00000100:00100000:2.0:1789023679.814702:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:2.0:1789023679.814713:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:11094:x1875927007052672:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023679.814738:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023679.814758:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341890e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbe6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.814814:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341890e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbe6 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.814827:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341890e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbe6 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.814857:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023679.814873:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023679.814876:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07800, rc 0) 00000100:00100000:2.0:1789023679.814941:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11094:x1875927007052672:12345-192.168.203.48@tcp:101:bash.0 Request processed in 230us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.814948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 192 00000100:00100000:1.0:1789023679.817768:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.817959:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007052800 00000100:00100000:2.0:1789023679.817967:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007052800 00000100:00100000:2.0:1789023679.818025:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:2.0:1789023679.818035:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:11094:x1875927007052800:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023679.818050:0:7164:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023679.818068:0:7164:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbed expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789023679.818092:0:7164:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa255bd, atime: 0x6aa255bc, ctime: 0x6aa255bd, blocks: 0xb 00010000:00010000:2.0:1789023679.818111:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1789023679.818115:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023679.818122:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 8 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.818136:0:7164:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 8 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.818148:0:7164:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023679.818204:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:11094:x1875927007052800:12345-192.168.203.48@tcp:101:bash.0 Request processed in 170us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.818211:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1789023679.820819:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.820913:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007052928 00000100:00100000:2.0:1789023679.820926:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007052928 00002000:00010000:2.0:1789023679.820966:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789023679.820971:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f78c5500 with x1875927007052928 ext(0->18446744073709551615) 00002000:00010000:2.0:1789023679.820982:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f78c5500. 00000100:00100000:2.0:1789023679.821015:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1789023679.821025:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2363:x1875927007052928:12345-192.168.203.48@tcp:10:bash.0 00002000:00010000:2.0:1789023679.821308:0:6701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789023679.821311:0:6701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789023677 -> 1789023679 00002000:00010000:2.0:1789023679.821313:0:6701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789023676 -> 1789023676 00002000:00010000:2.0:1789023679.821315:0:6701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789023677 -> 1789023679 00002000:00010000:2.0:1789023679.821317:0:6701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1789023679.821425:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2363:x1875927007052928:12345-192.168.203.48@tcp:10:bash.0 Request processed in 401us (614us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789023679.821432:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00002000:00010000:2.0:1789023679.821436:0:6701:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1789023679.821439:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f78c5500 with x1875927007052928 ext(0->18446744073709551615) 00002000:00010000:2.0:1789023679.821443:0:6701:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f78c5500. 00000100:00100000:1.0:1789023679.900216:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.900309:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007053056 00000100:00100000:0.0:1789023679.900331:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007053056 00000100:00100000:0.0:1789023679.900394:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:0.0:1789023679.900404:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11574:x1875927007053056:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:0.0:1789023679.900505:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900522:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900534:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900550:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900557:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900564:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900794:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900804:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900810:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789023679.900848:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900869:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900875:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900898:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900905:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.900909:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900916:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900928:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023679.900930:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.900935:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900941:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb341891c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900956:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900962:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900967:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900978:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.900981:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900987:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.900996:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65c8ebd300) 00010000:00010000:0.0:1789023679.900998:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.901000:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901006:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418923 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901020:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901026:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901031:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901037:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023679.901039:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901046:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901065:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023679.901067:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023679.901070:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.901076:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb341892a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.901164:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11574:x1875927007053056:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 759us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023679.901173:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 193 00000100:00100000:1.0:1789023679.945320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.945411:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007053312 00000100:00100000:2.0:1789023679.945421:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007053312 00000100:00100000:2.0:1789023679.945531:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:2.0:1789023679.945543:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11577:x1875927007053312:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023679.945562:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023679.945592:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418931 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbf4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.945697:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.945713:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.945726:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.945740:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.945746:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.945753:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946015:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418946 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946025:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946032:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418946 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023679.946042:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789023679.946126:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946133:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946146:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946152:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023679.946169:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946177:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946189:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023679.946193:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023679.946197:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946203:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418938 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946216:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946222:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946227:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946233:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023679.946235:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946250:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946258:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1800) 00010000:00010000:2.0:1789023679.946260:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023679.946263:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946270:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341893f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946309:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418931 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbf4 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946321:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418946 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbf4 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.946327:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023679.946329:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789023679.946332:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06000, rc 0) 00000100:00100000:2.0:1789023679.946390:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:11577:x1875927007053312:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 850us (1080us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789023679.946398:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 194 00000100:00100000:1.0:1789023679.953465:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.953613:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007053440 00000100:00100000:0.0:1789023679.953623:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007053440 00000100:00100000:0.0:1789023679.953689:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:0.0:1789023679.953698:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:11577:x1875927007053440:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:0.0:1789023679.953763:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.953780:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.953788:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.953820:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 34 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.953834:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 34 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.953857:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024870272:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023679.954789:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324300 going to sleep for 11 seconds 00000100:00100000:0.0:1789023679.968411:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023679.968596:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024870272:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023679.968626:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023679.969064:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007053696 00000100:00100000:1.0:1789023679.969072:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007053696 00000100:00100000:1.0:1789023679.969128:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1789023679.969137:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:5600:x1875927007053696:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789023679.969454:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+36:5600:x1875927007053696:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 317us (1052us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1789023679.969462:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:1.0:1789023679.977989:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023679.978080:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007053824 00000100:00100000:0.0:1789023679.978090:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007053824 00010000:00010000:0.0:1789023679.978130:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 36 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.978180:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:0.0:1789023679.978191:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+36:2361:x1875927007053824:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023679.978205:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023679.978212:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 36 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.978232:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 36 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.978256:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb34188f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbdf expref: 36 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.978277:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023679.978282:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.978291:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.978317:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023679.978352:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023679.978624:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978639:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978679:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978686:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978692:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978697:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023679.978701:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978708:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978717:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023679.978720:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023679.978724:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023679.978730:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418954 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023679.978911:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:2361:x1875927007053824:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 721us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023679.978919:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:2.0:1789023679.980358:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:11577:x1875927007053440:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 26657us (26898us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023679.980368:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 195 00000100:00100000:0.0:1789023679.983105:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023679.983369:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007054080 00000100:00100000:1.0:1789023679.983443:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007054080 00000100:00100000:0.0:1789023679.986439:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:0.0:1789023679.986462:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+34:11577:x1875927007054080:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789023679.986746:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:11577:x1875927007054080:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 293us (3648us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789023679.986753:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:3.0:1789023680.085638:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.086056:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007054336 00000100:00100000:2.0:1789023680.086066:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007054336 00000100:00100000:2.0:1789023680.086154:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00100000:2.0:1789023680.086164:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+35:11588:x1875927007054336:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789023680.086186:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.086206:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341895b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfbfb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086279:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086294:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086305:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086321:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086328:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086334:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086641:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418970 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086651:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086683:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418970 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023680.086693:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1789023680.086788:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086796:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086803:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086809:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.086813:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086820:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086832:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023680.086835:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.086840:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086847:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086860:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086866:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086877:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086882:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.086885:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086890:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086897:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1800) 00010000:00010000:2.0:1789023680.086899:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.086902:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086907:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418969 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086949:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341895b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbfb expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086964:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418970 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbfb expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.086971:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.086973:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023680.086976:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06e00, rc 0) 00000100:00100000:2.0:1789023680.087049:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:11588:x1875927007054336:12345-192.168.203.48@tcp:101:cat.0 Request processed in 887us (1418us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789023680.087066:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 196 00000100:00080000:0.0:1789023680.087647:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023680.093448:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023680.093728:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007054592 00000100:00100000:3.0:1789023680.093738:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007054592 00000100:00100000:3.0:1789023680.093797:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:3.0:1789023680.093813:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:11588:x1875927007054592:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:3.0:1789023680.094066:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:11588:x1875927007054592:12345-192.168.203.48@tcp:35:cat.0 Request processed in 256us (627us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789023680.094078:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 54 00000100:00100000:3.0:1789023680.120317:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.120422:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007054848 00000100:00100000:2.0:1789023680.120432:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007054848 00000100:00100000:2.0:1789023680.120598:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 197 00000100:00100000:2.0:1789023680.120607:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:11589:x1875927007054848:12345-192.168.203.48@tcp:36:rm.0 00010000:00010000:2.0:1789023680.120661:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789023680.120705:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418970 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbfb expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120729:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbf4 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120742:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341890e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbe6 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120752:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.120762:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023680.120780:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120792:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120801:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120814:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120836:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.120843:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121074:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121083:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121089:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023680.121777:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1789023680.121787:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346192309161ns, next at 347192307071ns, rc = 0 00010000:00010000:2.0:1789023680.121842:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121852:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121859:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121867:0:7654:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121873:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121888:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121959:0:7654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023680.121980:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121987:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121993:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.121998:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.122002:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122009:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122019:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:2.0:1789023680.122021:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789023680.122026:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122032:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb341898c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122049:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122055:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122068:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122073:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.122075:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122081:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122089:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023680.122092:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.122094:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.122100:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341897e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023680.122111:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec7b36f9 reply state 0000000092ef2763 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.122120:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023680.122201:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+37:11589:x1875927007054848:12345-192.168.203.48@tcp:36:rm.0 Request processed in 1593us (1892us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789023680.122215:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 197 00010000:00010000:3.0:1789023680.123519:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023680.123529:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.123538:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07c00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023680.123553:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.123562:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.123577:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e65f41d1900) 00010000:00010000:3.0:1789023680.123580:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789023680.123584:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.123591:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.123609:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023680.123611:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023680.123613:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023680.124436:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.124447:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.124454:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.124459:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023680.124463:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.124469:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.124509:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1800) 00010000:00010000:3.0:1789023680.124512:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023680.124516:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.124522:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418985 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023680.155801:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.155930:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007055104 00000100:00100000:2.0:1789023680.155951:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007055104 00000100:00100000:2.0:1789023680.156075:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 198 00000100:00100000:2.0:1789023680.156087:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+36:11595:x1875927007055104:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023680.156138:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.156159:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341899a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc02 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.156291:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.156306:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.156318:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.156332:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.156340:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.156347:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023680.156924:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789023680.157078:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157088:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157096:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157142:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157150:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157157:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157164:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.157168:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157175:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157186:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023680.157189:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.157194:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157199:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023680.157212:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1972f5a reply state 00000000ff338b8c transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.157219:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789023680.157245:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341899a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157272:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.157280:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1000) 00010000:00010000:2.0:1789023680.157283:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023680.157285:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06000, rc 0) 00000100:00100000:2.0:1789023680.157363:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+39:11595:x1875927007055104:12345-192.168.203.48@tcp:101:bash.0 Request processed in 1279us (1613us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789023680.157372:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 198 00010000:00010000:2.0:1789023680.161010:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161026:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161034:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161040:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.161044:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161050:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161065:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.161067:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.161072:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161093:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34189a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023680.161586:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.161628:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007055232 00000100:00100000:2.0:1789023680.161637:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007055232 00000100:00100000:2.0:1789023680.161697:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:2.0:1789023680.161707:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007055232:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023680.161723:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.161741:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc09 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789023680.161767:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789023680.161785:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1789023680.161789:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023680.161798:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161815:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.161827:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06e00, rc 0) 00000100:00100000:2.0:1789023680.161879:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2362:x1875927007055232:12345-192.168.203.48@tcp:101:bash.0 Request processed in 173us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.161961:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:1.0:1789023680.171812:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.171891:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007055360 00000100:00100000:2.0:1789023680.171901:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007055360 00000100:00100000:2.0:1789023680.171981:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:2.0:1789023680.171992:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:11595:x1875927007055360:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023680.172010:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.172027:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc10 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.172058:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.172068:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023680.172072:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023680.172078:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.172110:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.172123:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 7 pid: 6694 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.172137:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c247b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875927024870400:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023680.172235:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1b11540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023680.174443:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c247b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6695:1875927024870400:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023680.174518:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.174572:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07800, rc 0) 00000100:00100000:2.0:1789023680.174638:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:11595:x1875927007055360:12345-192.168.203.48@tcp:101:bash.0 Request processed in 2648us (2834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.174647:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789023680.176854:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.177034:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007055488 00000100:00100000:0.0:1789023680.177044:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007055488 00010000:00010000:0.0:1789023680.177081:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 7 pid: 6694 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023680.177124:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:0.0:1789023680.177134:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c2f85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007055488:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023680.177149:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023680.177169:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 7 pid: 6694 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.177197:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 7 pid: 6694 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.177219:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029254a74/0xc3c1fcbfb34189bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc09 expref: 7 pid: 6694 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.177247:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023680.177251:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023680.177258:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.177268:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.177305:0:6710:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023680.177320:0:6710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6710:1875927024870528:192.168.203.48@tcp:105: 00000100:00100000:0.0:1789023680.177395:0:6710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023680.187925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.188033:0:6710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6710:1875927024870528:192.168.203.48@tcp:105: 00010000:00010000:0.0:1789023680.188058:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023680.188117:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c2f85850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007055488:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 10984us (11270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023680.188128:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:3.0:1789023680.188258:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007055744 00000100:00100000:3.0:1789023680.188265:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007055744 00000100:00100000:3.0:1789023680.188314:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 55 00000100:00100000:3.0:1789023680.188324:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+38:11595:x1875927007055744:12345-192.168.203.48@tcp:35:bash.0 00000001:00080000:3.0:1789023680.188884:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967484 00000100:00100000:3.0:1789023680.188963:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+40:11595:x1875927007055744:12345-192.168.203.48@tcp:35:bash.0 Request processed in 640us (1047us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789023680.188970:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 55 00000020:00080000:3.0:1789023680.188974:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789023680.381186:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.384417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007055872 00000100:00100000:0.0:1789023680.384432:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007055872 00000100:00100000:0.0:1789023680.385110:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:0.0:1789023680.385124:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+40:11611:x1875927007055872:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023680.385150:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023680.385179:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34189cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc17 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.385240:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34189d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.385254:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34189d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.385266:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34189d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023680.385297:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789023680.385300:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023680.385315:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34189d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.385336:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb34189cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc17 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.385356:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34189d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc17 expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.385364:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023680.385367:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023680.385383:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05800, rc 0) 00000100:00100000:0.0:1789023680.385448:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:11611:x1875927007055872:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 328us (4284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023680.385455:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 199 00000100:00100000:1.0:1789023680.393128:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.393294:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007056128 00000100:00100000:2.0:1789023680.393303:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007056128 00000100:00100000:2.0:1789023680.393408:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:2.0:1789023680.393419:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+41:11611:x1875927007056128:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023680.393440:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.393459:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34189d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc1e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.393592:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.393607:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.393619:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023680.393629:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789023680.393755:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34189d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc1e expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.393774:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc1e expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.393800:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1000) 00010000:00010000:2.0:1789023680.393803:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023680.393806:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06c00, rc 0) 00000100:00100000:2.0:1789023680.393864:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+43:11611:x1875927007056128:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 447us (747us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789023680.393871:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 200 00000100:00100000:1.0:1789023680.408015:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023680.408070:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023680.408164:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007056256 00000100:00100000:3.0:1789023680.408174:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007056256 00000100:00100000:3.0:1789023680.408241:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1789023680.408252:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+43:2362:x1875927007056256:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023680.408266:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023680.408290:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb34189e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc1e expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.408322:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1000) 00010000:00010000:3.0:1789023680.408328:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023680.408380:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:2362:x1875927007056256:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 130us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023680.408387:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:2.0:1789023680.408748:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007056512 00000100:00100000:2.0:1789023680.408754:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007056512 00000100:00100000:2.0:1789023680.408798:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:2.0:1789023680.408807:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+42:11611:x1875927007056512:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023680.408826:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.408842:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34189ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc25 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.408936:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34189f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.408950:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34189f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.408960:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34189f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023680.408973:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789023680.409091:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb34189ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc25 expref: 45 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.409119:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34189f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc25 expref: 44 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.409127:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1000) 00010000:00010000:2.0:1789023680.409130:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789023680.409133:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06e00, rc 0) 00000100:00100000:2.0:1789023680.409162:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+44:11611:x1875927007056512:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 357us (1092us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1789023680.409168:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 201 00000100:00100000:3.0:1789023680.416800:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.416944:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007056640 00000100:00100000:0.0:1789023680.416954:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007056640 00000100:00100000:0.0:1789023680.416999:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:0.0:1789023680.417008:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+6:2361:x1875927007056640:12345-192.168.203.48@tcp:1:lfs.0 00010000:00010000:0.0:1789023680.417047:0:6696:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.417065:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.417073:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023680.417077:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023680.417081:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.417111:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.417124:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 6 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023680.417137:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875927024870656:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023680.417239:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023680.420348:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.420466:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6696:1875927024870656:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023680.420512:0:6696:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.420597:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007056768 00000100:00100000:2.0:1789023680.420605:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007056768 00002000:00100000:2.0:1789023680.420649:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e65ffcdea00 x1875927007056768/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:606/0 lens 504/0 e 0 to 0 dl 1789023691 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789023680.420658:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65ffcdea00 with x1875927007056768 ext(0->8) 00010000:00010000:2.0:1789023680.420678:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 7 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.420692:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 7 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789023680.420699:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65ffcdea00 00000100:00100000:2.0:1789023680.420730:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789023680.420739:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007056768:12345-192.168.203.48@tcp:4:lfs.0 00000100:00100000:2.0:1789023680.421243:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007056768:12345-192.168.203.48@tcp:4:lfs.0 Request processed in 503us (901us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789023680.421256:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00002000:00100000:2.0:1789023680.421264:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e65ffcdea00 x1875927007056768/t4294967308(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:606/0 lens 504/448 e 0 to 0 dl 1789023691 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789023680.421271:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65ffcdea00 with x1875927007056768 ext(0->8) 00010000:00010000:2.0:1789023680.421276:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 9 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.421287:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 9 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789023680.421294:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e65ffcdea00 00000100:00100000:1.0:1789023680.425205:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.425569:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007056896 00000100:00100000:2.0:1789023680.425685:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007056896 00010000:00010000:2.0:1789023680.425724:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 9 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.425815:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1789023680.425826:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007056896:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023680.425851:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789023680.425871:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789023680.425874:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789023680 00002000:00010000:2.0:1789023680.425877:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789023680 00002000:00010000:2.0:1789023680.425879:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789023680 00010000:00010000:2.0:1789023680.425893:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 9 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.425922:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 9 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.425943:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004473a8ce/0xc3c1fcbfb34189c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc10 expref: 9 pid: 6695 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.425960:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023680.425963:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023680.425968:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.425977:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.426015:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023680.426074:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007056896:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 250us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.426081:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00010000:00010000:1.0:1789023680.427190:0:6696:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427204:0:6696:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427241:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427265:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427273:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427280:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05c00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023680.427284:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427292:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427305:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.427311:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000467e0471/0xc3c1fcbfb3418a03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023680.427379:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007056640:12345-192.168.203.48@tcp:1:lfs.0 Request processed in 10371us (10587us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023680.427387:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:1.0:1789023680.430851:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023680.431044:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007057152 00000100:00100000:3.0:1789023680.431052:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007057152 00000100:00100000:3.0:1789023680.431095:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 56 00000100:00100000:3.0:1789023680.431102:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+44:11611:x1875927007057152:12345-192.168.203.48@tcp:35:lfs.0 00000004:00010000:3.0:1789023680.431152:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34189f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc25 expref: 44 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789023680.431390:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789023680.431431:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789023680.432086:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1789023680.432145:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.432162:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.432170:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.432203:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.432233:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 48 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023680.432247:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875927024870784:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023680.432364:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023680.443861:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023680.443977:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007057280 00000100:00100000:3.0:1789023680.443988:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007057280 00010000:00010000:3.0:1789023680.444026:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 49 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023680.444113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:3.0:1789023680.444122:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:2361:x1875927007057280:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023680.444136:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023680.444143:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 49 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.444156:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 49 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.444186:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1000) 00010000:00010000:3.0:1789023680.444192:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.444201:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.444225:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.444243:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023680.444301:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+49:2361:x1875927007057280:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 180us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023680.444309:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00010000:00010000:2.0:1789023680.447088:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb34189af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc02 expref: 48 pid: 5846 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.447111:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5848:1875927024870784:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023680.447134:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.447161:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.447168:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789023680.447796:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789023680.447988:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789023680.448094:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c247b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024870912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789023680.448152:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023680.448187:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2965e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023680.448928:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024870912 00000100:00100000:3.0:1789023680.448936:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024870912 00000100:00100000:3.0:1789023680.448989:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789023680.448998:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875927024870912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789023680.449083:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2479880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875927024870912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 86us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023680.449090:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789023680.449774:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c247b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024870912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789023680.450734:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1789023680.450813:0:5848:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024871040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789023680.450861:0:5848:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023680.450932:0:5848:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023680.452453:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024871040 00000100:00100000:2.0:1789023680.452464:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024871040 00000100:00100000:2.0:1789023680.452528:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789023680.452537:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875927024871040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789023680.453437:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5848:x1875927024871040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 899us (2573us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789023680.453444:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789023680.457932:0:5848:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5848:1875927024871040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789023680.458032:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789023680.458090:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.458101:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.458108:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.458129:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713ce00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023680.458135:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.458143:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.458233:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1000) 00010000:00010000:3.0:1789023680.458238:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789023680.458244:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.458250:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789023680.458454:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789023680.458587:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1789023680.458599:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 346529120948ns, next at 347529119051ns, rc = 0 00000001:00080000:3.0:1789023680.458606:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1789023680.458764:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1000) 00010000:00010000:3.0:1789023680.458767:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789023680.458775:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb34189f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc25 expref: 52 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023680.458900:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9afb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:11611:x1875927007057152:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 27796us (28055us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789023680.458909:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 56 00000020:00080000:3.0:1789023680.458914:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789023680.462434:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.462744:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007057408 00000100:00100000:2.0:1789023680.462754:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007057408 00000100:00100000:2.0:1789023680.462848:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:2.0:1789023680.462859:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+51:11611:x1875927007057408:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023680.462892:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.462915:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418a11 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc2c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.462990:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc2c expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.463006:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418a11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc2c expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.463025:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.463028:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789023680.463032:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06000, rc 0) 00000100:00100000:2.0:1789023680.463090:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:11611:x1875927007057408:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 233us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.463097:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 202 00000100:00100000:3.0:1789023680.466414:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.466876:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007057664 00000100:00100000:0.0:1789023680.466895:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007057664 00000100:00100000:0.0:1789023680.466942:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:0.0:1789023680.466952:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+52:11611:x1875927007057664:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789023680.467173:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11611:x1875927007057664:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 221us (771us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789023680.467180:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 57 00000100:00100000:3.0:1789023680.564471:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.564696:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007057792 00000100:00100000:2.0:1789023680.564706:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007057792 00000100:00100000:2.0:1789023680.564755:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:2.0:1789023680.564765:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11621:x1875927007057792:12345-192.168.203.48@tcp:34:lfs.0 00010000:00010000:2.0:1789023680.565100:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565117:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565129:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565145:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565168:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565175:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565257:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565266:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565273:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023680.565313:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565325:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565332:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565338:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565345:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.565349:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565356:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565374:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023680.565377:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.565382:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565388:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565402:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565408:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565414:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565419:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.565422:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565428:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565435:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65f41d1100) 00010000:00010000:2.0:1789023680.565437:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.565440:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565445:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565470:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565520:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565528:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565533:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.565536:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565542:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565550:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.565552:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023680.565555:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.565560:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.565627:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11621:x1875927007057792:12345-192.168.203.48@tcp:34:lfs.0 Request processed in 862us (1164us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.565635:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 203 00000100:00100000:0.0:1789023680.604232:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023680.604328:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007058048 00000100:00100000:1.0:1789023680.604337:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007058048 00000100:00100000:1.0:1789023680.604446:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 204 00000100:00100000:1.0:1789023680.604456:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+53:11624:x1875927007058048:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023680.604514:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023680.604534:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418a2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc33 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.604611:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.604625:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.604635:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.604647:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.604653:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.604659:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605108:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418a42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605116:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605136:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418a42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023680.605145:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789023680.605232:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605239:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605246:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605251:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fa00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023680.605255:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605262:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605274:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023680.605276:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023680.605281:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605289:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418a34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605306:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605311:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605323:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605328:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023680.605331:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605337:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605345:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65eea05800) 00010000:00010000:1.0:1789023680.605347:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023680.605350:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605355:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418a3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605396:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418a2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc33 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605410:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418a42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc33 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.605416:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:1.0:1789023680.605418:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023680.605421:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707f600, rc 0) 00000100:00100000:1.0:1789023680.605593:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:11624:x1875927007058048:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1137us (1369us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789023680.605611:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 204 00000100:00100000:0.0:1789023680.611217:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.611417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007058176 00000100:00100000:2.0:1789023680.611426:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007058176 00000100:00100000:2.0:1789023680.611514:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:2.0:1789023680.611538:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:11624:x1875927007058176:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:2.0:1789023680.612775:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612794:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612806:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612834:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612841:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612849:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612854:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023680.612858:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612865:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612876:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.612947:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023680.612953:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.612960:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.613055:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:11624:x1875927007058176:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 1517us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.613064:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 205 00000100:00100000:1.0:1789023680.617998:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.620123:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007058432 00000100:00100000:0.0:1789023680.620136:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007058432 00000100:00100000:0.0:1789023680.620202:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:0.0:1789023680.620213:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+55:11624:x1875927007058432:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:0.0:1789023680.620766:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:11624:x1875927007058432:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 553us (2775us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1789023680.620774:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 58 00000100:00100000:3.0:1789023680.720388:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.720603:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007058688 00000100:00100000:2.0:1789023680.720613:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007058688 00000100:00100000:2.0:1789023680.720683:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:2.0:1789023680.720694:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+56:11634:x1875927007058688:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023680.720717:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.720720:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789023680.720744:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05800/0xc3c1fcbfb34189d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc17 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.720767:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023680.720772:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023680.720785:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a57 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc3a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.720886:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.720900:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.720919:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023680.720929:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789023680.721046:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a57 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc3a expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.721075:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc3a expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.721083:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.721086:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023680.721089:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06a00, rc 0) 00000100:00100000:2.0:1789023680.721432:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11634:x1875927007058688:12345-192.168.203.48@tcp:101:bash.0 Request processed in 739us (1052us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1789023680.721440:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 206 00000100:00100000:2.0:1789023680.727600:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.728108:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007058944 00000100:00100000:0.0:1789023680.728118:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007058944 00000100:00100000:0.0:1789023680.728213:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 207 00000100:00100000:0.0:1789023680.728234:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11634:x1875927007058944:12345-192.168.203.48@tcp:36:bash.0 00010000:00010000:0.0:1789023680.728286:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1789023680.728323:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418a5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc3a expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.728347:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f600/0xc3c1fcbfb3418a42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc33 expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.728363:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023680.728368:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023680.728612:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.728625:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.728636:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789023680.728698:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1789023680.728723:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044303263 reply state 0000000017ca5fc8 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023680.728732:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789023680.728828:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11634:x1875927007058944:12345-192.168.203.48@tcp:36:bash.0 Request processed in 607us (1238us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1789023680.729028:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 207 00000020:00080000:0.0:1789023680.729033:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789023680.731043:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:3.0:1789023680.731172:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.731184:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.731192:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.731199:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023680.731204:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.731211:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.731226:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023680.731229:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789023680.731230:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007059072 00010000:00010000:3.0:1789023680.731233:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.731238:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb3418a6c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.731239:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007059072 00000100:00100000:2.0:1789023680.731294:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:2.0:1789023680.731305:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+57:11634:x1875927007059072:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023680.731326:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.731341:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc41 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.731429:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.731441:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.731451:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023680.731516:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789023680.731521:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023680.731692:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.731719:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.731736:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.731743:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.731746:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023680.731748:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07800, rc 0) 00000100:00100000:2.0:1789023680.731804:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11634:x1875927007059072:12345-192.168.203.48@tcp:101:bash.0 Request processed in 501us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.731811:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 208 00000100:00100000:1.0:1789023680.737601:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023680.737719:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007059328 00000100:00100000:3.0:1789023680.737729:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007059328 00000100:00100000:3.0:1789023680.737786:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 59 00000100:00100000:3.0:1789023680.737797:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+58:11634:x1875927007059328:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:3.0:1789023680.738019:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2246680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11634:x1875927007059328:12345-192.168.203.48@tcp:35:bash.0 Request processed in 223us (426us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789023680.738042:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 59 00010000:00010000:0.0:1789023680.777688:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023680.825302:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.825647:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007059456 00000100:00100000:2.0:1789023680.825657:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007059456 00000100:00100000:2.0:1789023680.825726:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:2.0:1789023680.825736:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+59:11640:x1875927007059456:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023680.825758:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.825777:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc48 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.825836:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418a88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.825865:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.825878:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023680.825918:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789023680.825922:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023680.825939:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418a88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.825963:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418a81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc48 expref: 61 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.825982:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418a88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc48 expref: 60 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.825990:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023680.825993:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023680.825997:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023680.826056:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11640:x1875927007059456:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 321us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.826071:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 209 00000100:00100000:1.0:1789023680.832270:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023680.833017:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007059584 00000100:00100000:3.0:1789023680.833030:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007059584 00000100:00100000:3.0:1789023680.833096:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:3.0:1789023680.833107:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11640:x1875927007059584:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023680.833129:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023680.833152:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a8f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc4f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833216:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833244:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833256:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833272:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833279:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833285:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833369:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418aa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833391:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833399:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023680.833433:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789023680.833437:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023680.833457:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833468:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418aa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833509:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833517:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833524:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833530:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713dc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023680.833534:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833541:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833553:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:3.0:1789023680.833555:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023680.833567:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833573:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713dc00/0xc3c1fcbfb3418a96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833586:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833592:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833598:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833603:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023680.833606:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833611:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833618:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65c6960900) 00010000:00010000:3.0:1789023680.833620:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023680.833623:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833628:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418a9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833658:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418a8f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc4f expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833699:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418aa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc4f expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.833706:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023680.833708:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789023680.833711:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713cc00, rc 0) 00000100:00100000:3.0:1789023680.833775:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11640:x1875927007059584:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 670us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023680.833782:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 210 00000100:00100000:1.0:1789023680.840535:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023680.840626:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.840710:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007059968 00000100:00100000:0.0:1789023680.840720:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007059968 00000100:00100000:0.0:1789023680.840789:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:0.0:1789023680.840800:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:2361:x1875927007059968:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023680.840831:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023680.840855:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3418aa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc4f expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.840873:0:6710:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023680.840878:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023680.840940:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:2361:x1875927007059968:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 142us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023680.840948:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:2.0:1789023680.841179:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007059840 00000100:00100000:2.0:1789023680.841184:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007059840 00000100:00100000:2.0:1789023680.841223:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:2.0:1789023680.841232:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11640:x1875927007059840:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023680.841247:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023680.841268:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418aab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc56 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.841357:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.841372:0:7654:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.841382:0:7654:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.841415:0:7654:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.841427:0:7654:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 61 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023680.841440:0:7654:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024871168:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023680.841544:0:7654:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2965840 going to sleep for 11 seconds 00000100:00100000:2.0:1789023680.847123:0:7654:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2478e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7654:1875927024871168:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023680.847150:0:7654:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023680.849155:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023680.849301:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007060096 00000100:00100000:3.0:1789023680.849325:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007060096 00010000:00010000:3.0:1789023680.849363:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 62 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023680.849402:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:3.0:1789023680.849411:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:2362:x1875927007060096:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023680.849427:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023680.849434:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 62 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.849447:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 62 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.849469:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418a7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc41 expref: 62 pid: 5847 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.849535:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023680.849541:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.849550:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.849558:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023680.849588:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023680.849635:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:2362:x1875927007060096:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 224us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023680.849643:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00010000:00010000:2.0:1789023680.850352:0:7654:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.850364:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023680.850394:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789023680.850646:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418aab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 62 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.850689:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 61 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.850698:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023680.850700:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789023680.850703:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07400, rc 0) 00000100:00100000:2.0:1789023680.850750:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11640:x1875927007059840:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 9519us (10226us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1789023680.850758:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 211 00000100:00100000:1.0:1789023680.854585:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.854701:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007060352 00000100:00100000:0.0:1789023680.854712:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007060352 00000100:00100000:1.0:1789023680.854800:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1789023680.854814:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11640:x1875927007060352:12345-192.168.203.48@tcp:103:lfs.0 00010000:00010000:1.0:1789023680.854832:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023680.854860:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418a11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc2c expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023680.854881:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:1.0:1789023680.854887:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023680.854951:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11640:x1875927007060352:12345-192.168.203.48@tcp:103:lfs.0 Request processed in 142us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023680.854959:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:1.0:1789023680.859195:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023680.859350:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007060480 00000100:00100000:2.0:1789023680.859361:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007060480 00000100:00100000:2.0:1789023680.859417:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:2.0:1789023680.859427:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11640:x1875927007060480:12345-192.168.203.48@tcp:58:lfs.0 00010000:00010000:2.0:1789023680.859569:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.859586:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023680.859598:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023680.859793:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789023680.859893:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11640:x1875927007060480:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 467us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023680.859901:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 212 00000100:00100000:2.0:1789023680.866151:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023680.866379:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007060608 00000100:00100000:0.0:1789023680.866389:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007060608 00000100:00100000:0.0:1789023680.866448:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 213 00000100:00100000:0.0:1789023680.866457:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+60:11640:x1875927007060608:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023680.866502:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023680.866523:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc5d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.866583:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.866594:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.866613:0:5845:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.866641:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.866654:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023680.866657:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789023680.866671:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023680.866680:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05400, rc 0) 00000100:00100000:0.0:1789023680.866793:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2478e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11640:x1875927007060608:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 337us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023680.866801:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 213 00000040:00080000:3.0:1789023681.225801:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789023681.225811:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789023681.225846:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 5 00000040:00080000:3.0:1789023681.225852:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789023681.225965:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024871296:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789023681.226145:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023681.234848:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023681.234966:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dca80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024871296:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789023681.236179:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007060736 00000100:00100000:0.0:1789023681.236192:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007060736 00000100:00100000:0.0:1789023681.236261:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:0.0:1789023681.236271:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11641:x1875927007060736:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789023681.236301:0:5846:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789023681.236402:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11641:x1875927007060736:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 132us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.236410:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 214 00000100:00100000:1.0:1789023681.238911:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.239009:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007060864 00000100:00100000:2.0:1789023681.239018:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007060864 00000100:00100000:2.0:1789023681.239124:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:2.0:1789023681.239135:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11641:x1875927007060864:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789023681.239202:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239218:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239230:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239245:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239251:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239257:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239281:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239290:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239312:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023681.239351:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789023681.239355:0:7654:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023681.239367:0:7654:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239377:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239384:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239390:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239396:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023681.239400:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239407:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239419:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:2.0:1789023681.239422:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023681.239427:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239433:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ace lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239460:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239466:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239472:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239536:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023681.239540:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239546:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239554:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e65f41d1100) 00010000:00010000:2.0:1789023681.239556:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023681.239558:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239564:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418ad5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239578:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239583:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239588:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239602:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023681.239605:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239611:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239619:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023681.239621:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023681.239624:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.239629:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418adc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023681.239711:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11641:x1875927007060864:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 577us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.239719:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 215 00000100:00100000:1.0:1789023681.244531:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.244629:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007061120 00000100:00100000:2.0:1789023681.244640:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007061120 00000100:00100000:2.0:1789023681.244704:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:2.0:1789023681.244714:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+61:11641:x1875927007061120:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023681.244733:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023681.244752:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ae3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc64 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.244846:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.244878:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.244890:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023681.244903:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789023681.244997:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245005:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245012:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245019:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023681.245023:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245030:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245042:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:2.0:1789023681.245045:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789023681.245049:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245055:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418aea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245097:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ae3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc64 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245115:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:2.0:1789023681.245118:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023681.245122:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418ae3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc64 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.245132:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06200, rc 0) 00000100:00100000:2.0:1789023681.245207:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11641:x1875927007061120:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 494us (685us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1789023681.245215:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 216 00000100:00100000:1.0:1789023681.249815:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.249913:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007061248 00000100:00100000:0.0:1789023681.249924:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007061248 00000100:00100000:0.0:1789023681.249977:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:0.0:1789023681.249987:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11641:x1875927007061248:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789023681.250044:0:5845:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789023681.250154:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11641:x1875927007061248:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 168us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.250162:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 217 00000100:00100000:1.0:1789023681.254930:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.255034:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007061504 00000100:00100000:2.0:1789023681.255046:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007061504 00000100:00100000:2.0:1789023681.255111:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:2.0:1789023681.255123:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11641:x1875927007061504:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023681.255144:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023681.255148:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789023681.255185:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418a88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc48 expref: 62 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.255207:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:2.0:1789023681.255213:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023681.255233:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418af8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc6b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789023681.255693:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789023681.255900:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418aff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.255921:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.255932:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.255989:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418af8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc6b expref: 64 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.256008:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418aff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc6b expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.256016:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1100) 00010000:00010000:2.0:1789023681.256019:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023681.256022:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06c00, rc 0) 00000100:00100000:2.0:1789023681.256077:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11641:x1875927007061504:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 957us (1156us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789023681.256086:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 218 00000100:00100000:1.0:1789023681.262083:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.262198:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007061760 00000100:00100000:0.0:1789023681.262210:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007061760 00000100:00100000:0.0:1789023681.262308:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:0.0:1789023681.262320:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11641:x1875927007061760:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789023681.262387:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023681.262413:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06c00/0xc3c1fcbfb3418aff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc6b expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262434:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1100) 00010000:00010000:0.0:1789023681.262445:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023681.262465:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262515:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262527:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262541:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262548:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262555:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262638:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262646:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262653:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262668:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023681.262672:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262680:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262689:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023681.262692:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023681.262695:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262702:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b0d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262712:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262718:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262725:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262735:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023681.262739:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262745:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262752:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x480c9d19 (ffff8e65c8ebd300) 00010000:00010000:0.0:1789023681.262755:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023681.262758:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.262764:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x480c9d19 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.262837:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11641:x1875927007061760:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 519us (776us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789023681.262845:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 219 00000100:00100000:1.0:1789023681.268192:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.268283:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007061888 00000100:00100000:2.0:1789023681.268293:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007061888 00000100:00100000:2.0:1789023681.268345:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:2.0:1789023681.268356:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+62:11641:x1875927007061888:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023681.268375:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023681.268396:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418b1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc72 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.268432:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.268458:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.268469:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.268592:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06200/0xc3c1fcbfb3418b1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 64 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.268612:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.268621:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023681.268623:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789023681.268627:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06a00, rc 0) 00000100:00100000:2.0:1789023681.268704:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11641:x1875927007061888:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 350us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.268712:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 220 00000100:00100000:1.0:1789023681.273297:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.273446:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007062144 00000100:00100000:2.0:1789023681.273456:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007062144 00000100:00100000:2.0:1789023681.273557:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 221 00000100:00100000:2.0:1789023681.273569:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+63:11641:x1875927007062144:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789023681.273667:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.273686:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.273719:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023681.274006:0:7654:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789023681.274018:0:7654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347344539341ns, next at 348344536668ns, rc = 0 00000004:00010000:2.0:1789023681.274117:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c9cb0bc reply state 000000003f67bec0 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023681.274126:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023681.274313:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+65:11641:x1875927007062144:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 745us (1025us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789023681.274321:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 221 00010000:00010000:2.0:1789023681.279914:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.279932:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.279940:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.279947:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023681.279952:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.279959:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.279976:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023681.279979:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789023681.280000:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.280006:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418b29 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023681.280366:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.280463:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007062272 00000100:00100000:0.0:1789023681.280472:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007062272 00000100:00100000:0.0:1789023681.280565:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:0.0:1789023681.280575:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+64:11641:x1875927007062272:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023681.280599:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023681.280616:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc79 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.280678:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 65 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.280708:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 65 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.280727:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023681.280730:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789023681.280732:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05000, rc 0) 00000100:00100000:0.0:1789023681.280793:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+65:11641:x1875927007062272:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 220us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.280800:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 222 00000100:00100000:3.0:1789023681.291380:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023681.291442:0:12456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007062400 00000100:00100000:1.0:1789023681.291452:0:12456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007062400 00000100:00100000:1.0:1789023681.291564:0:12456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:1.0:1789023681.291575:0:12456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2363:x1875927007062400:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789023681.291882:0:12456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2363:x1875927007062400:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 308us (522us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789023681.291890:0:12456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00080000:0.0:1789023681.292447:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023681.296158:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.296401:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007062656 00000100:00100000:0.0:1789023681.296410:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007062656 00000100:00100000:0.0:1789023681.296468:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:0.0:1789023681.296773:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+65:11641:x1875927007062656:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789023681.297168:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+66:11641:x1875927007062656:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 688us (1017us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789023681.297187:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 60 00000100:00100000:3.0:1789023681.299995:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.300333:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007062912 00000100:00100000:2.0:1789023681.300343:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007062912 00000100:00100000:2.0:1789023681.300426:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 223 00000100:00100000:2.0:1789023681.300438:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+66:11641:x1875927007062912:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789023681.301055:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+66:11641:x1875927007062912:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 618us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.301065:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 223 00000100:00100000:2.0:1789023681.306020:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.306114:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007063040 00000100:00100000:0.0:1789023681.306123:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007063040 00000100:00100000:0.0:1789023681.306181:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:0.0:1789023681.306192:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+66:11641:x1875927007063040:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023681.306214:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023681.306234:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b37 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc80 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.306466:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418b3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.306502:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.306531:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023681.306567:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023681.306586:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.306693:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b37 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc80 expref: 68 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.306712:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc80 expref: 67 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.306720:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023681.306723:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789023681.306726:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04400, rc 0) 00000100:00100000:0.0:1789023681.306780:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2478700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+67:11641:x1875927007063040:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 591us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.306788:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 224 00000100:00100000:3.0:1789023681.309389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.309552:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007063168 00000100:00100000:0.0:1789023681.309562:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007063168 00000100:00100000:0.0:1789023681.309616:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:0.0:1789023681.309626:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+10:2361:x1875927007063168:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023681.309641:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023681.309671:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc87 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789023681.309711:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa255c1, blocks: 0x1 00010000:00010000:0.0:1789023681.309731:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1789023681.309735:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023681.309745:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.309765:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 11 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.309776:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05e00, rc 0) 00000100:00100000:0.0:1789023681.309825:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:2361:x1875927007063168:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 201us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.309831:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1789023681.312204:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.312319:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007063424 00000100:00100000:2.0:1789023681.312328:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007063424 00000100:00100000:2.0:1789023681.312379:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 225 00000100:00100000:2.0:1789023681.312388:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f40e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+67:11641:x1875927007063424:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789023681.312522:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f40e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+67:11641:x1875927007063424:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.312537:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 225 00000100:00100000:1.0:1789023681.319142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.319225:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007063552 00000100:00100000:0.0:1789023681.319235:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007063552 00000100:00100000:0.0:1789023681.319290:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:0.0:1789023681.319301:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:11641:x1875927007063552:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023681.319317:0:6696:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023681.319334:0:6696:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc8e expref: -99 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.319365:0:6696:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.319392:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023681.319396:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023681.319401:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.319434:0:6696:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 12 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.319447:0:6696:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 12 pid: 6695 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.319460:0:6696:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024871424:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023681.319599:0:6696:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023681.323915:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.324062:0:6696:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6696:1875927024871424:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023681.324098:0:6696:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 12 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.324152:0:6696:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04600, rc 0) 00000100:00100000:0.0:1789023681.324220:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:11641:x1875927007063552:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 4915us (5083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.324230:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1789023681.325087:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007063680 00000100:00100000:1.0:1789023681.325096:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007063680 00010000:00010000:1.0:1789023681.325132:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 12 pid: 6695 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023681.325202:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:1.0:1789023681.325213:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f415a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:2361:x1875927007063680:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023681.325413:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023681.325435:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 12 pid: 6695 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.325458:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 12 pid: 6695 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.325619:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8ea4440/0xc3c1fcbfb3418b45 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc87 expref: 12 pid: 6695 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.325639:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023681.325643:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023681.325651:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.325670:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.325709:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 11 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023681.325724:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1875927024871552:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789023681.325820:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2480 going to sleep for 11 seconds 00000100:00100000:3.0:1789023681.329164:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023681.329184:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f50e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5832:1875927024871552:192.168.203.48@tcp:105: 00010000:00010000:1.0:1789023681.329208:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023681.329308:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f415a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:2361:x1875927007063680:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 4096us (5400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023681.329318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:0.0:1789023681.329787:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007063808 00000100:00100000:0.0:1789023681.329795:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007063808 00002000:00100000:0.0:1789023681.329840:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8e65f7981180 x1875927007063808/t0(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:607/0 lens 504/0 e 0 to 0 dl 1789023692 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023681.329856:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f7981180 with x1875927007063808 ext(0->12) 00002000:00010000:0.0:1789023681.329862:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f7981180 00000100:00100000:0.0:1789023681.330207:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1789023681.330228:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+11:2361:x1875927007063808:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789023681.330694:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:2361:x1875927007063808:12345-192.168.203.48@tcp:4:lhsmtool_posix.0 Request processed in 476us (1538us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789023681.330701:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00002000:00100000:0.0:1789023681.330707:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8e65f7981180 x1875927007063808/t4294967320(0) o4->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:607/0 lens 504/448 e 0 to 0 dl 1789023692 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023681.330717:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f7981180 with x1875927007063808 ext(0->12) 00002000:00010000:0.0:1789023681.330721:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f7981180 00000100:00100000:3.0:1789023681.332577:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023681.332686:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007063936 00000100:00100000:1.0:1789023681.332748:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007063936 00000100:00100000:1.0:1789023681.332788:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 226 00000100:00100000:1.0:1789023681.332795:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+67:11641:x1875927007063936:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789023681.367205:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000001:00080000:3.0:1789023681.367247:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1789023681.367266:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:3.0:1789023681.367303:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:3.0:1789023681.367325:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:3.0:1789023681.367342:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789023681.367360:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e65d069da80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789023681.367365:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65c137b400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e65d069d480 00000020:00080000:3.0:1789023681.367368:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65c137bb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65c842d800 00000020:00080000:3.0:1789023681.367385:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e65f40b29c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789023681.367389:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65de0db500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e65f40b26c0 00000020:00080000:3.0:1789023681.367391:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65de0db200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65fcb46400 00000020:00080000:2.0:1789023681.367682:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789023681.367868:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789023681.368000:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024871680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789023681.368073:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023681.368239:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024871680 00000100:00100000:2.0:1789023681.368246:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024871680 00000100:00100000:2.0:1789023681.368307:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789023681.368316:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024871680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789023681.368341:0:7164:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1789023681.368381:0:7164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.368403:0:7164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 12 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.368412:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789023681.368416:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023681.368421:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.368446:0:7164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 12 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.368460:0:7164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 12 pid: 7164 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023681.368472:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2479500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024871936:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023681.368564:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2965b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023681.369186:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024872064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789023681.369232:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023681.369258:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789023681.369263:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024871808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789023681.369285:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023681.369308:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024872064 00000100:00100000:0.0:1789023681.369313:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024872064 00000100:00100000:0.0:1789023681.369336:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024871808 00000100:00100000:0.0:1789023681.369338:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024871808 00000100:00100000:0.0:1789023681.369349:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023681.369355:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875927024872064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1789023681.369370:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1789023681.369396:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa255c0, atime: 0x6aa255c0, ctime: 0x6aa255c0, blocks: 0x1 00010000:00010000:0.0:1789023681.369411:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.369422:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=347s v=(0 0) 00010000:00010000:0.0:1789023681.369425:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023681.369431:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.369446:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.369456:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.369464:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.369496:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789023681.370439:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1875927024872064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1079us (1202us total) trans 4294967310 rc 0/0 00000100:00080000:3.0:1789023681.370446:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023681.370448:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789023681.370450:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789023681.372613:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023681.372627:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.372641:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023681.372647:0:7645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.372689:0:7645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.372708:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.372715:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000894e0706/0xc3c1fcbfb3418b5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.372744:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023681.372746:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023681.372748:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023681.372774:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789023681.372787:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3313:x1875927024871808:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1789023681.373107:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e65df3d5c00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1789023681.373115:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024872064:0@lo:6:osp-syn-1-0.0 00002000:00010000:3.0:1789023681.373826:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789023681.373832:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789023681 00002000:00010000:3.0:1789023681.373835:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789023681.373837:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789023681 -> 1789023681 00002000:00010000:3.0:1789023681.373839:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789023681.373976:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6989850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3313:x1875927024871808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1192us (4689us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1789023681.373986:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789023681.375740:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.376131:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007064064 00000100:00100000:0.0:1789023681.376140:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007064064 00010000:00010000:0.0:1789023681.376177:0:6710:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 13 pid: 7164 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.376225:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:0.0:1789023681.376235:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:2361:x1875927007064064:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023681.376264:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023681.376271:0:6710:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 13 pid: 7164 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376285:0:6710:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 13 pid: 7164 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376308:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023681.376312:0:6710:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023681.376318:0:6710:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376328:0:6710:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376348:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023681.376399:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+13:2361:x1875927007064064:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 165us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.376407:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00010000:00010000:0.0:1789023681.376454:0:7164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b26d5d51/0xc3c1fcbfb3418915 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbed expref: 12 pid: 7164 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.376467:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2479500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024871936:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023681.376509:0:7164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376529:0:7164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376537:0:7164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376546:0:7164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376554:0:7164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.376571:0:7164:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789023681.377214:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3311:x1875927024871680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8897us (9138us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1789023681.377223:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:0.0:1789023681.377365:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023681.377372:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.377381:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023681.377386:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.377395:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.377417:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.377423:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418b53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.377442:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023681.377443:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023681.377445:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789023681.377677:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e64c2479180/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789023681.377684:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2479180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024871680:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789023681.377897:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11641:x1875927007063936:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 45099us (45323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023681.377906:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 226 00000004:00080000:2.0:1789023681.382602:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e64c2479c00/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789023681.382615:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2479c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024871808:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789023681.383160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.383384:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007064192 00000100:00100000:0.0:1789023681.383392:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007064192 00000100:00100000:0.0:1789023681.383449:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:0.0:1789023681.383457:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+12:2362:x1875927007064192:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1789023681.414551:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1789023681.414567:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1789023681.415420:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007064192:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 31947us (32246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.415433:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:3.0:1789023681.420606:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.420676:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007064448 00000100:00100000:2.0:1789023681.420686:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007064448 00000100:00100000:2.0:1789023681.420791:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 227 00000100:00100000:2.0:1789023681.420802:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11641:x1875927007064448:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789023681.420850:0:7654:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023681.420874:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04400/0xc3c1fcbfb3418b3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc80 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.420893:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023681.420897:0:7654:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789023681.420924:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.420936:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.420946:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023681.421180:0:7654:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000adc69e14 reply state 0000000005d2fbc7 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023681.421189:0:7654:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023681.421468:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:11641:x1875927007064448:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 667us (871us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789023681.421639:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 227 00010000:00010000:0.0:1789023681.423251:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.423266:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.423273:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.423280:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023681.423285:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.423293:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.423323:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023681.423326:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023681.423331:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.423338:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb3418b61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023681.425346:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023681.425418:0:12456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007064576 00000100:00100000:1.0:1789023681.425428:0:12456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007064576 00000100:00100000:1.0:1789023681.425522:0:12456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:1.0:1789023681.425729:0:12456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2362:x1875927007064576:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789023681.425972:0:12456:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789023681.425976:0:12456:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789023681 -> 1789023680 00002000:00010000:1.0:1789023681.425979:0:12456:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789023680 00002000:00010000:1.0:1789023681.425981:0:12456:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789023681 -> 1789023680 00002000:00010000:1.0:1789023681.425984:0:12456:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789023681.426195:0:12456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007064576:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 468us (858us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789023681.431393:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023681.431692:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007064832 00000100:00100000:3.0:1789023681.431702:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007064832 00000100:00100000:3.0:1789023681.431756:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00100000:3.0:1789023681.431766:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11641:x1875927007064832:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789023681.431837:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.431855:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.431863:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.431898:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.431912:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 20 pid: 5847 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023681.431926:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7982680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024872192:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023681.432114:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023681.432689:0:12456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1789023681.436764:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.436815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007064960 00000100:00100000:0.0:1789023681.436825:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007064960 00000100:00100000:3.0:1789023681.436860:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7982680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024872192:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023681.436880:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 21 pid: 5847 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.436898:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.436921:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:0.0:1789023681.436931:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:2362:x1875927007064960:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023681.436945:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023681.436951:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 21 pid: 5847 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.436963:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 21 pid: 5847 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.436984:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3418b22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc72 expref: 21 pid: 5847 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.437000:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023681.437004:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.437182:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.437191:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.437220:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023681.437251:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.437258:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.437274:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:2362:x1875927007064960:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 343us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.437280:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00010000:00010000:3.0:1789023681.437284:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.437291:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.437297:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.437304:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023681.437308:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.437315:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.437324:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:3.0:1789023681.437327:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789023681.437331:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.437337:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023681.437389:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2478000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11641:x1875927007064832:12345-192.168.203.48@tcp:55:lhsmtool_posix.0 Request processed in 5624us (6008us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789023681.437397:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 228 00000100:00100000:3.0:1789023681.440893:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.441010:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007065088 00000100:00100000:0.0:1789023681.441026:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007065088 00000100:00100000:0.0:1789023681.441074:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:0.0:1789023681.441084:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2363:x1875927007065088:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789023681.441125:0:7164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.441144:0:7164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.441153:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023681.441157:0:7164:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789023681.441162:0:7164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.441191:0:7164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 8 pid: 6696 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.441232:0:7164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 8 pid: 6696 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.441246:0:7164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024872320:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023681.441520:0:7164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1b119c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023681.446318:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023681.446403:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007065216 00000100:00100000:3.0:1789023681.446412:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007065216 00010000:00010000:3.0:1789023681.446449:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 9 pid: 6696 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023681.446518:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:3.0:1789023681.446539:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007065216:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023681.446554:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023681.446577:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 9 pid: 6696 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.446591:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 9 pid: 6696 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.446614:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789023681.446619:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789023681.446625:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.446635:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.446677:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023681.446723:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2478380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+9:2361:x1875927007065216:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 196us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023681.446730:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00010000:00010000:0.0:1789023681.448676:0:7164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1b31cc2/0xc3c1fcbfb3418b4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc8e expref: 8 pid: 6696 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.448698:0:7164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7164:1875927024872320:192.168.203.48@tcp:104: 00010000:00010000:0.0:1789023681.448720:0:7164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.448731:0:7164:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.448738:0:7164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.448769:0:7164:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.448777:0:7164:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.448805:0:7164:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.448811:0:7164:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023681.448815:0:7164:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.448823:0:7164:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.449120:0:7164:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.449131:0:7164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4d29fd9/0xc3c1fcbfb3418b6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.449277:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2363:x1875927007065088:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 8192us (8402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.449286:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 70 00000100:00100000:2.0:1789023681.452188:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023681.452322:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007065472 00000100:00100000:1.0:1789023681.452331:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007065472 00000100:00100000:1.0:1789023681.452409:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 229 00000100:00100000:1.0:1789023681.452420:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11641:x1875927007065472:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789023681.452523:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.452565:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.452577:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.452768:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.452779:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.452788:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.452818:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.452831:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 20 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023681.452845:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024872448:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023681.452933:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023681.456305:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.456374:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007065600 00000100:00100000:0.0:1789023681.456383:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007065600 00010000:00010000:0.0:1789023681.456421:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 21 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.456459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:0.0:1789023681.456503:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:2361:x1875927007065600:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023681.456520:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023681.456535:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 21 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.456548:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 21 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.456568:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:0.0:1789023681.456573:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.456583:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.456590:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.456605:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023681.456651:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:2361:x1875927007065600:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 151us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.456668:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00010000:00010000:1.0:1789023681.457260:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418b30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc79 expref: 20 pid: 5845 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023681.457279:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024872448:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023681.457299:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.457316:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.457322:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789023681.457651:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789023681.457800:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:1.0:1789023681.457842:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789023681.458027:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875927024872576:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789023681.458089:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023681.458157:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2900 going to sleep for 11 seconds 00000100:00100000:0.0:1789023681.459338:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024872576 00000100:00100000:0.0:1789023681.459349:0:5851:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024872576 00000100:00100000:0.0:1789023681.459441:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023681.459451:0:5851:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875927024872576:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789023681.459575:0:5851:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875927024872576:12345-0@lo:1000:mdt00_002.0 Request processed in 125us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.459595:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789023681.459674:0:5847:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1789023681.459680:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65f78c4700, transno 4294967315 00000004:00080000:1.0:1789023681.459698:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:1.0:1789023681.459715:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e64c2479c00, transno 4294967321 00000004:00080000:1.0:1789023681.459719:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e64c2479180, transno 4294967322 00000100:00100000:1.0:1789023681.459724:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875927024872576:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789023681.460201:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:1.0:1789023681.460284:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875927024872704:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789023681.460321:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1789023681.460767:0:6846:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1789023681.461121:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789023681.461165:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024872704 00000100:00100000:2.0:1789023681.461172:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024872704 00000100:00100000:2.0:1789023681.461208:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789023681.461283:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875927024872704:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789023681.461546:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1875927024872704:12345-0@lo:1000:mdt00_002.0 Request processed in 330us (1223us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1789023681.461554:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789023681.461718:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5847:1875927024872704:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789023681.461752:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.461762:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.461780:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.461787:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023681.461792:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.461801:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.461816:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:1.0:1789023681.461819:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023681.461824:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.461830:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fc00/0xc3c1fcbfb3418b7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462129:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462136:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462142:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462146:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023681.462149:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462165:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462175:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:1.0:1789023681.462177:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023681.462185:0:5847:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462196:0:5847:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462206:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.462307:0:5847:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023681.462320:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024872832:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789023681.462446:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789023681.466350:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.466847:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007065728 00000100:00100000:2.0:1789023681.466858:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007065728 00000100:00100000:2.0:1789023681.466993:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:2.0:1789023681.467004:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:11640:x1875927007065728:12345-192.168.203.48@tcp:49:lfs.0 00000100:00100000:2.0:1789023681.467240:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+24:11640:x1875927007065728:12345-192.168.203.48@tcp:49:lfs.0 Request processed in 237us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.467248:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 61 00000100:00100000:1.0:1789023681.467414:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5847:1875927024872832:192.168.203.48@tcp:105: 00010000:00010000:1.0:1789023681.467441:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467451:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06e00/0xc3c1fcbfb3418ac0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467655:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467691:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467702:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467713:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467719:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467726:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467731:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023681.467736:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467742:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467751:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:1.0:1789023681.467754:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023681.467757:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467762:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e600/0xc3c1fcbfb3418b84 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467776:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467790:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467795:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467800:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023681.467803:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467809:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467817:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:1.0:1789023681.467819:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789023681.467822:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023681.467828:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f400/0xc3c1fcbfb3418b76 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023681.468132:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:11641:x1875927007065472:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 15712us (15950us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1789023681.468141:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 229 00000020:00080000:1.0:1789023681.468146:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789023681.471720:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023681.471756:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023681.471822:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007065984 00000100:00100000:3.0:1789023681.471840:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007065984 00000100:00100000:3.0:1789023681.471899:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 62 00000100:00100000:3.0:1789023681.471908:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:11641:x1875927007065984:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789023681.472604:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789023681.472715:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1789023681.472759:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.472775:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.472786:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.472794:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.472801:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.472817:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.472838:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789023681.472923:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9af8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11641:x1875927007065984:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1014us (1208us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789023681.472933:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 62 00000020:00080000:3.0:1789023681.472938:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789023681.472992:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023681.472999:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.473006:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023681.473010:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.473018:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.473030:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e65c6960900) 00010000:00010000:3.0:1789023681.473033:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789023681.473037:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.473042:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418b8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.473057:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023681.473059:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023681.473061:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023681.474173:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007066240 00000100:00100000:0.0:1789023681.474185:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007066240 00000100:00100000:0.0:1789023681.474248:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 230 00000100:00100000:0.0:1789023681.474258:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11640:x1875927007066240:12345-192.168.203.48@tcp:58:lfs.0 00000040:00080000:0.0:1789023681.474471:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1789023681.474952:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11640:x1875927007066240:12345-192.168.203.48@tcp:58:lfs.0 Request processed in 693us (3193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.474961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 230 00000040:00080000:2.0:1789023681.481765:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023681.481773:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023681.481812:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1789023681.481817:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789023681.482179:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2479500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024872960:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789023681.482442:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023681.492352:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2479500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11701:1875927024872960:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789023681.493931:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.494073:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007066368 00000100:00100000:2.0:1789023681.494083:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007066368 00000100:00100000:2.0:1789023681.494139:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 231 00000100:00100000:2.0:1789023681.494149:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11642:x1875927007066368:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789023681.494198:0:7654:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789023681.494296:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11642:x1875927007066368:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 147us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.494303:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 231 00000100:00100000:3.0:1789023681.500432:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.500570:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007066624 00000100:00100000:0.0:1789023681.500580:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007066624 00000100:00100000:0.0:1789023681.500645:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 232 00000100:00100000:0.0:1789023681.500665:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+25:11642:x1875927007066624:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789023681.500687:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023681.500707:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b92 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc95 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.500805:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418b99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.500821:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.500841:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418b99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023681.500854:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789023681.500988:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418b92 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc95 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.501024:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418b99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc95 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.501035:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023681.501038:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789023681.501041:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05c00, rc 0) 00000100:00100000:0.0:1789023681.501105:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:11642:x1875927007066624:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 452us (682us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1789023681.501112:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 232 00000100:00100000:3.0:1789023681.518450:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023681.518578:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007066880 00000100:00100000:2.0:1789023681.518588:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007066880 00000100:00100000:2.0:1789023681.518648:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 233 00000100:00100000:2.0:1789023681.518667:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+27:11642:x1875927007066880:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789023681.518744:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.518760:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023681.518771:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.519090:0:7654:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.519099:0:7654:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.519105:0:7654:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.519110:0:7654:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d06000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023681.519115:0:7654:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.519121:0:7654:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.519134:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023681.519137:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789023681.519141:0:7654:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.519147:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06000/0xc3c1fcbfb3418ba7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023681.519314:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+28:11642:x1875927007066880:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 656us (872us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789023681.519323:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 233 00000040:00080000:0.0:1789023681.519747:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023681.519753:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789023681.520255:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 6 00000040:00080000:0.0:1789023681.520264:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789023681.525420:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023681.525548:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007067136 00000100:00100000:3.0:1789023681.525558:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007067136 00000100:00100000:3.0:1789023681.525612:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1789023681.525637:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+28:11642:x1875927007067136:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789023681.525980:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:11642:x1875927007067136:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 345us (569us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789023681.525989:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 63 00000100:00100000:3.0:1789023681.529304:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023681.529392:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007067264 00000100:00100000:0.0:1789023681.529402:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007067264 00000100:00100000:0.0:1789023681.529516:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 234 00000100:00100000:0.0:1789023681.529537:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+29:11644:x1875927007067264:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:0.0:1789023681.529559:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023681.529582:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418bae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfc9c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.529648:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.529673:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.529704:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.529721:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.529728:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.529735:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.530790:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.530807:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 30 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.530817:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.530996:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 30 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.531011:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 30 pid: 7654 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023681.531025:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024873088:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023681.531103:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1b119c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023681.533693:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5845:1875927024873088:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023681.533722:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023681.537215:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023681.537313:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007067520 00000100:00100000:1.0:1789023681.537334:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007067520 00000100:00100000:1.0:1789023681.537387:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:1.0:1789023681.537397:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:9982:x1875927007067520:12345-192.168.203.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789023681.537689:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:9982:x1875927007067520:12345-192.168.203.48@tcp:35:ldlm_bl.0 Request processed in 292us (484us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789023681.537696:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 64 00000100:00100000:0.0:1789023681.540610:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023681.540693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007067648 00000100:00100000:3.0:1789023681.540703:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007067648 00010000:00010000:3.0:1789023681.540741:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 32 pid: 7654 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023681.540773:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:3.0:1789023681.540781:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:2362:x1875927007067648:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023681.540794:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023681.540800:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 32 pid: 7654 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.540813:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 32 pid: 7654 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.540836:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3418ab2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc56 expref: 32 pid: 7654 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.540882:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023681.540889:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.540898:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.540906:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023681.540935:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023681.540990:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+31:2362:x1875927007067648:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 209us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023681.540998:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00010000:00010000:0.0:1789023681.541112:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541120:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023681.541162:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789023681.541167:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023681.541184:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541196:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541206:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541222:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541230:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541236:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023681.541240:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541252:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541261:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023681.541264:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023681.541276:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541283:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04200/0xc3c1fcbfb3418bb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541296:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541302:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541307:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541313:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023681.541315:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541321:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541329:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e65c8ebd300) 00010000:00010000:0.0:1789023681.541331:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023681.541334:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541340:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05000/0xc3c1fcbfb3418bbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541375:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418bae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc9c expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541402:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc9c expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023681.541410:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023681.541412:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789023681.541414:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05200, rc 0) 00000100:00100000:0.0:1789023681.541440:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:11644:x1875927007067264:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 11917us (12146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023681.541447:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 234 00000100:00100000:1.0:1789023681.547036:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024873216:0@lo:400:kworker.0 00000100:00100000:1.0:1789023681.547105:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023681.547207:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024873216 00000100:00100000:2.0:1789023681.547227:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024873216 00000100:00100000:2.0:1789023681.547282:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789023681.547292:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024873216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023681.548349:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024873344:0@lo:400:kworker.0 00000100:00100000:3.0:1789023681.548398:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023681.548446:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024873344 00000100:00100000:3.0:1789023681.548451:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024873344 00000100:00100000:3.0:1789023681.548503:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789023681.548511:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024873344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023681.548554:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024873344:12345-0@lo:400:kworker.0 Request processed in 43us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023681.548561:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789023681.548602:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024873344:0@lo:400:kworker.0 00000100:00100000:2.0:1789023681.553920:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0933c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024873216:12345-0@lo:400:kworker.0 Request processed in 6618us (6803us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023681.553936:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789023681.554371:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024873216:0@lo:400:kworker.0 00000100:00100000:2.0:1789023681.559728:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024873472:0@lo:400:kworker.0 00000100:00100000:2.0:1789023681.559797:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023681.560187:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024873600:0@lo:400:kworker.0 00000100:00100000:3.0:1789023681.560218:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023681.562750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024873472 00000100:00100000:0.0:1789023681.562763:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024873472 00000100:00100000:1.0:1789023681.566355:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024873600 00000100:00100000:1.0:1789023681.566370:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024873600 00000100:00100000:1.0:1789023681.566472:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789023681.566505:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024873600:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789023681.566717:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023681.566828:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024873600:12345-0@lo:400:kworker.0 Request processed in 328us (6608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023681.566846:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789023681.566981:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024873600:0@lo:400:kworker.0 00000100:00100000:1.0:1789023681.567205:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789023681.567213:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024873472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023681.567258:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2479500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024873472:12345-0@lo:400:kworker.0 Request processed in 46us (7462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023681.567263:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789023681.567292:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024873472:0@lo:400:kworker.0 00000100:00080000:3.0:1789023681.567384:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789023681.801741:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023682.058015:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024873728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023682.058083:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023682.060808:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024873728 00000100:00100000:2.0:1789023682.060837:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024873728 00000100:00100000:2.0:1789023682.060943:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789023682.060953:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1875927024873728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023682.060990:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023682.061073:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1875927024873728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (2989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023682.061081:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789023682.061153:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7980e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024873728:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789023682.225729:0:12533:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023682.225738:0:12533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023682.225806:0:12533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 6 00000040:00080000:2.0:1789023682.225812:0:12533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789023682.403087:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023682.403136:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007067904 00000100:00100000:3.0:1789023682.403149:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007067904 00000100:00100000:3.0:1789023682.403236:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 235 00000100:00100000:3.0:1789023682.403248:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+30:11667:x1875927007067904:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023682.403280:0:7654:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023682.403308:0:7654:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418bca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfca3 expref: -99 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.403454:0:7654:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418bd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.403473:0:7654:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.403523:0:7654:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7654 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023682.403538:0:7654:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789023682.403713:0:7654:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713ce00/0xc3c1fcbfb3418bca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfca3 expref: 33 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.403733:0:7654:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfca3 expref: 32 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.403741:0:7654:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023682.403757:0:7654:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789023682.403762:0:7654:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d000, rc 0) 00000100:00100000:3.0:1789023682.403840:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11667:x1875927007067904:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 593us (764us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789023682.403849:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 235 00000100:00080000:0.0:1789023682.405786:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023682.410780:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023682.410967:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068032 00000100:00100000:3.0:1789023682.410984:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068032 00000100:00100000:3.0:1789023682.411056:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:3.0:1789023682.411067:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11667:x1875927007068032:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:3.0:1789023682.411163:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411186:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411202:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411235:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411244:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411252:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411259:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023682.411266:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411294:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411311:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:3.0:1789023682.411315:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789023682.411323:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023682.411330:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d400/0xc3c1fcbfb3418bdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023682.411436:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:11667:x1875927007068032:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 370us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023682.411447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 236 00000100:00100000:3.0:1789023682.514046:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023682.514158:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068160 00000100:00100000:2.0:1789023682.514174:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068160 00000100:00100000:2.0:1789023682.514271:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:2.0:1789023682.514284:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2361:x1875927007068160:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789023682.514300:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023682.514321:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418be6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfcaa expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789023682.514347:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa255c0, atime: 0x6aa255c0, ctime: 0x6aa255c0, blocks: 0xb 00010000:00010000:2.0:1789023682.514368:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=348s v=(0 0) 00010000:00010000:2.0:1789023682.514373:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023682.514382:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418be6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcaa expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023682.514401:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418be6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcaa expref: 8 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023682.514433:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06200, rc 0) 00000100:00100000:2.0:1789023682.514541:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2361:x1875927007068160:12345-192.168.203.48@tcp:101:cat.0 Request processed in 260us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023682.514550:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 71 00000100:00100000:3.0:1789023682.520642:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023682.520830:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068288 00000100:00100000:0.0:1789023682.520840:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068288 00002000:00100000:0.0:1789023682.520899:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8e65f7980e00 x1875927007068288/t0(0) o3->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:608/0 lens 488/0 e 0 to 0 dl 1789023693 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023682.520910:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f7980e00 with x1875927007068288 ext(0->4095) 00002000:00010000:0.0:1789023682.520916:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f7980e00 00000100:00100000:0.0:1789023682.520950:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789023682.520961:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007068288:12345-192.168.203.48@tcp:3:cat.0 00000100:00100000:0.0:1789023682.521153:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007068288:12345-192.168.203.48@tcp:3:cat.0 Request processed in 193us (520us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789023682.521160:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00002000:00100000:0.0:1789023682.521185:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8e65f7980e00 x1875927007068288/t0(0) o3->fa0f4aba-40ac-42f8-b5d5-b35db811ced7@192.168.203.48@tcp:608/0 lens 488/4536 e 0 to 0 dl 1789023693 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789023682.521193:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8e65f7980e00 with x1875927007068288 ext(0->4095) 00002000:00010000:0.0:1789023682.521196:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e65f7980e00 00000040:00080000:2.0:1789023682.571938:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789023682.571948:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789023682.572807:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789023682.572816:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789023682.828577:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023683.849834:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789023684.164840:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789023684.164859:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1789023684.593770:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023684.593821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023684.594082:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068416 00000100:00100000:1.0:1789023684.594092:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068416 00000100:00100000:1.0:1789023684.594158:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 290 00000100:00100000:1.0:1789023684.594168:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007068416:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023684.594257:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2361:x1875927007068416:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 83us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023684.594265:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 290 00000100:00100000:3.0:1789023684.594466:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068544 00000100:00100000:3.0:1789023684.594472:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068544 00000100:00100000:2.0:1789023684.594525:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023684.594540:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:3.0:1789023684.594547:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:2361:x1875927007068544:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023684.594547:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023684.594586:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+32:2361:x1875927007068544:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 39us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023684.594593:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 145 00000100:00100000:3.0:1789023684.594615:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068800 00000100:00100000:3.0:1789023684.594619:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068800 00000100:00100000:3.0:1789023684.594667:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068672 00000100:00100000:3.0:1789023684.594671:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068672 00000100:00100000:3.0:1789023684.594692:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:3.0:1789023684.594698:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007068800:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023684.594724:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2362:x1875927007068800:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023684.594729:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:3.0:1789023684.594740:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:3.0:1789023684.594746:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c247b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007068672:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023684.594768:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c247b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+8:2362:x1875927007068672:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 22us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023684.594774:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00080000:1.0:1789023684.595020:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023684.595024:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789023684.595026:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023684.598392:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023684.603730:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007068928 00000100:00100000:1.0:1789023684.603745:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007068928 00000100:00100000:1.0:1789023684.603901:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00100000:1.0:1789023684.603913:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2362:x1875927007068928:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023684.604118:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2479c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2362:x1875927007068928:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 207us (5734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023684.604127:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 146 00000100:00080000:0.0:1789023684.608310:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023684.618377:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023684.618401:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024873856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023684.618470:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023684.618682:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024873856 00000100:00100000:0.0:1789023684.618690:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024873856 00000100:00100000:0.0:1789023684.618800:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023684.618810:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875927024873856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023684.618865:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023684.618934:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875927024873856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023684.618942:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789023684.618985:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c318c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024873856:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789023684.622593:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789023684.877081:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023685.902223:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023686.670050:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024874112:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670125:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023686.670190:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024874624:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670240:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e70b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024874368:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670268:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023686.670302:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023686.670308:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024874240:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670328:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023686.670360:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024874112 00000100:00100000:3.0:1789023686.670367:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024874112 00000100:00100000:3.0:1789023686.670409:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789023686.670418:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024874112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670528:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024874112:12345-0@lo:400:kworker.0 Request processed in 110us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023686.670535:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789023686.670552:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024874240 00000100:00100000:3.0:1789023686.670555:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024874240 00000100:00100000:3.0:1789023686.670588:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789023686.670595:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024874240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670640:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024874240:12345-0@lo:400:kworker.0 Request processed in 46us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023686.670646:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789023686.670665:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024874368 00000100:00100000:3.0:1789023686.670668:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024874368 00000100:00100000:3.0:1789023686.670693:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789023686.670699:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875927024874368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670722:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875927024874368:12345-0@lo:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023686.670728:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789023686.670777:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c841c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024874240:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670789:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e70b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024874368:0@lo:400:kworker.0 00000100:00080000:1.0:1789023686.670790:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023686.670797:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023686.670840:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023686.670876:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024874112:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670886:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789023686.670891:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024873984:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670921:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023686.670941:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024874496:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.670976:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023686.671006:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024874624 00000100:00100000:3.0:1789023686.671014:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024874624 00000100:00100000:3.0:1789023686.671043:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789023686.671048:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024874624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.671086:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024874624:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023686.671092:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789023686.671110:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024873984 00000100:00100000:3.0:1789023686.671113:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024873984 00000100:00100000:3.0:1789023686.671135:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789023686.671141:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024873984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.671171:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0961850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024873984:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023686.671177:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1789023686.671218:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024873984:0@lo:400:kworker.0 00000100:00100000:3.0:1789023686.671227:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789023686.671231:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65f78c6a00, transno 4294967307 00000004:00080000:3.0:1789023686.671241:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1789023686.671256:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e65df3d5c00, transno 4294967310 00000100:00100000:3.0:1789023686.671261:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024874624:0@lo:400:kworker.0 00000100:00100000:1.0:1789023686.671338:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024874496 00000100:00100000:1.0:1789023686.671344:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024874496 00000100:00100000:1.0:1789023686.671376:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789023686.671385:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024874496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023686.671442:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024874496:12345-0@lo:400:kworker.0 Request processed in 59us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023686.671449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:1.0:1789023686.671467:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789023686.671470:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789023686.671520:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65d2781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024874496:0@lo:400:kworker.0 00000001:00080000:0.0:1789023686.757513:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:0.0:1789023686.757528:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789023686.757538:0:5867:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e65f6af2900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789023686.757543:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65f0087700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e65f6af2540 00000020:00080000:0.0:1789023686.757546:0:5867:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8e65f0087200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e65c8434000 00000020:00080000:0.0:1789023686.757569:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1789023686.757575:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1789023686.762589:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789023686.762817:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1789023686.763190:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1789023686.763201:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1789023686.923450:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023687.178774:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789023687.178796:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024874752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023687.178862:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023687.179135:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024874752 00000100:00100000:1.0:1789023687.179144:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024874752 00000100:00100000:1.0:1789023687.179195:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789023687.179205:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024874752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023687.179238:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023687.179286:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2669f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024874752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023687.179292:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789023687.179336:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024874752:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023687.593524:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023687.593630:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007069056 00000100:00100000:3.0:1789023687.593655:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007069056 00000100:00100000:3.0:1789023687.593735:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00100000:3.0:1789023687.593748:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11329:x1875927007069056:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789023687.593843:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2479180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11329:x1875927007069056:12345-192.168.203.48@tcp:60:lhsmtool_posix.0 Request processed in 98us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023687.593850:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 237 00000100:00080000:1.0:1789023687.593928:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023687.602144:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023687.604594:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007069312 00000100:00100000:1.0:1789023687.604610:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007069312 00000100:00100000:1.0:1789023687.604690:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 65 00000100:00100000:1.0:1789023687.604700:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:11329:x1875927007069312:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789023687.605586:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:11329:x1875927007069312:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 883us (3448us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789023687.605595:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 65 00010000:00010000:0.0:1789023687.945954:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023688.971889:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789023689.559303:0:12737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:01:27 (1789023687) 00000100:00100000:3.0:1789023689.710976:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023689.711023:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023689.711054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023689.711073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023689.711109:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023689.711136:0:12456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007069696 00000100:00100000:3.0:1789023689.711145:0:12456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007069696 00000100:00100000:3.0:1789023689.711365:0:12456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007069824 00000100:00100000:3.0:1789023689.711370:0:12456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007069824 00000100:00100000:3.0:1789023689.711394:0:12456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:3.0:1789023689.711404:0:12456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2363:x1875927007069696:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023689.711469:0:12456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2363:x1875927007069696:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 66us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023689.711493:0:12456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:3.0:1789023689.711512:0:12456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:3.0:1789023689.711519:0:12456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927007069824:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023689.711544:0:12456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2363:x1875927007069824:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023689.711564:0:12456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:3.0:1789023689.711583:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007069952 00000100:00100000:3.0:1789023689.711587:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007069952 00000100:00100000:3.0:1789023689.711622:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007069568 00000100:00100000:3.0:1789023689.711625:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007069568 00000100:00100000:3.0:1789023689.711650:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:3.0:1789023689.711657:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927007069952:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023689.711683:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2363:x1875927007069952:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023689.711690:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 150 00000100:00100000:3.0:1789023689.711701:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00100000:3.0:1789023689.711707:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c841c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:2363:x1875927007069568:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023689.711732:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c841c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:2363:x1875927007069568:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 25us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023689.711738:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 151 00000100:00080000:3.0:1789023689.711760:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789023689.711764:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789023689.711766:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023689.713851:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007069440 00000100:00100000:1.0:1789023689.713879:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007069440 00000100:00100000:1.0:1789023689.713951:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 292 00000100:00100000:1.0:1789023689.713960:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927007069440:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023689.714028:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2363:x1875927007069440:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 69us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023689.714035:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 292 00000100:00100000:3.0:1789023689.740401:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024874880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023689.740588:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023689.741325:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024874880 00000100:00100000:3.0:1789023689.741335:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024874880 00000100:00100000:3.0:1789023689.741388:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789023689.741398:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e71fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024874880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023689.741431:0:6698:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023689.741506:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e71fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024874880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023689.741514:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789023689.741846:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023689.741886:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789023689.741892:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789023689.741918:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024874880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789023689.993923:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023691.017809:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023691.701764:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023691.701915:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007070080 00000100:00100000:1.0:1789023691.701924:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007070080 00000100:00100000:1.0:1789023691.702007:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00100000:1.0:1789023691.702017:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:12331:x1875927007070080:12345-192.168.203.48@tcp:101:lsof.0 00010000:00010000:1.0:1789023691.702037:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023691.702066:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418bed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfcb1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023691.702124:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418bf4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023691.702137:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023691.702576:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023691.702634:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789023691.702639:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023691.702679:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418bf4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023691.702706:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ec00/0xc3c1fcbfb3418bed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcb1 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023691.702737:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418bf4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcb1 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023691.702746:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:1.0:1789023691.702749:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789023691.702753:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023691.702820:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:12331:x1875927007070080:12345-192.168.203.48@tcp:101:lsof.0 Request processed in 804us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023691.702828:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 238 00000100:00080000:3.0:1789023691.703662:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023691.785870:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024875136:0@lo:400:kworker.0 00000100:00100000:3.0:1789023691.785933:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023691.785989:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024875648:0@lo:400:kworker.0 00000100:00100000:3.0:1789023691.786009:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023691.786033:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789023691.786038:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024875008:0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786145:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875136 00000100:00100000:1.0:1789023691.786163:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875136 00000100:00100000:1.0:1789023691.786220:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789023691.786230:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024875136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786285:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024875136:12345-0@lo:400:kworker.0 Request processed in 57us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023691.786292:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789023691.786331:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024875392:0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786357:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023691.786382:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023691.786388:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024875264:0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786406:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023691.786431:0:12456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875648 00000100:00100000:1.0:1789023691.786434:0:12456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875648 00000100:00100000:1.0:1789023691.786463:0:12456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875392 00000100:00100000:1.0:1789023691.786465:0:12456:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875392 00000100:00100000:1.0:1789023691.786509:0:12456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789023691.786527:0:12456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024875648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786554:0:12456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024875648:12345-0@lo:400:kworker.0 Request processed in 29us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023691.786560:0:12456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789023691.786569:0:12456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789023691.786574:0:12456:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024875392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786610:0:12456:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024875392:12345-0@lo:400:kworker.0 Request processed in 35us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023691.786615:0:12456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1789023691.786636:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023691.786639:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789023691.786662:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024875392:0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786679:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875264 00000100:00100000:1.0:1789023691.786681:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875264 00000100:00100000:1.0:1789023691.786705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789023691.786709:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024875264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.786736:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024875264:12345-0@lo:400:kworker.0 Request processed in 27us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023691.786742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1789023691.786752:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023691.786763:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024875264:0@lo:400:kworker.0 00000100:00100000:3.0:1789023691.787552:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023691.787600:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024875520:0@lo:400:kworker.0 00000100:00100000:3.0:1789023691.787623:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023691.787650:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024875136:0@lo:400:kworker.0 00000100:00100000:3.0:1789023691.787660:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024875648:0@lo:400:kworker.0 00000100:00100000:3.0:1789023691.787683:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875520 00000100:00100000:3.0:1789023691.787686:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875520 00000100:00100000:3.0:1789023691.787723:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789023691.787729:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024875520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.787954:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875008 00000100:00100000:1.0:1789023691.787958:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875008 00000100:00100000:1.0:1789023691.787982:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1789023691.787988:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024875008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023691.788016:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024875008:12345-0@lo:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023691.788028:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00080000:1.0:1789023691.788370:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023691.788517:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024875008:0@lo:400:kworker.0 00000100:00100000:2.0:1789023691.788529:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024875520:0@lo:400:kworker.0 00000100:00100000:3.0:1789023691.788953:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024875520:12345-0@lo:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023691.788961:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000001:00080000:3.0:1789023691.845973:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:3.0:1789023691.845993:0:5867:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789023691.846036:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789023691.846047:0:5878:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789023692.042474:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023692.297918:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023692.297942:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024875776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023692.298025:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023692.298835:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875776 00000100:00100000:3.0:1789023692.298846:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875776 00000100:00100000:3.0:1789023692.298909:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789023692.298919:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024875776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789023692.298965:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023692.299032:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024875776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023692.299039:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789023692.299249:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024875776:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1789023692.811101:0:11701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789023692.811109:0:11701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789023692.812140:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789023692.812150:0:11701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789023693.065798:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023693.382828:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023693.382914:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007070336 00000100:00100000:3.0:1789023693.382924:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007070336 00000100:00100000:3.0:1789023693.383007:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:3.0:1789023693.383017:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+19:12332:x1875927007070336:12345-192.168.203.48@tcp:35:umount.0 00000100:00080000:1.0:1789023693.383312:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023693.383573:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:12332:x1875927007070336:12345-192.168.203.48@tcp:35:umount.0 Request processed in 556us (753us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1789023693.383590:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 66 00000100:00100000:0.0:1789023693.388573:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023693.389074:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007070592 00000100:00100000:3.0:1789023693.389084:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007070592 00000100:00100000:3.0:1789023693.389151:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:3.0:1789023693.389162:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+20:12332:x1875927007070592:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:3.0:1789023693.390949:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:12332:x1875927007070592:12345-192.168.203.48@tcp:35:umount.0 Request processed in 1782us (2378us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1789023693.390972:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 67 00000100:00100000:0.0:1789023693.399352:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023693.399741:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007070848 00000100:00100000:2.0:1789023693.399751:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007070848 00000100:00100000:2.0:1789023693.399810:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:2.0:1789023693.399820:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+21:12332:x1875927007070848:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:2.0:1789023693.400070:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c9afac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:12332:x1875927007070848:12345-192.168.203.48@tcp:35:umount.0 Request processed in 251us (725us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1789023693.400078:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 68 00000100:00100000:1.0:1789023693.406439:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023693.406573:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007071104 00000100:00100000:2.0:1789023693.406592:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007071104 00000100:00100000:2.0:1789023693.406683:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:2.0:1789023693.406694:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:12332:x1875927007071104:12345-192.168.203.48@tcp:35:umount.0 00000100:00100000:2.0:1789023693.407027:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:12332:x1875927007071104:12345-192.168.203.48@tcp:35:umount.0 Request processed in 334us (676us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1789023693.407034:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 69 00000100:00100000:0.0:1789023693.421957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023693.422056:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023693.423630:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023693.423824:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007071232 00000100:00100000:3.0:1789023693.423834:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007071232 00000100:00100000:3.0:1789023693.423899:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007071488 00000100:00100000:3.0:1789023693.423903:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007071488 00000100:00100000:3.0:1789023693.423935:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789023693.423946:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+14:2362:x1875927007071232:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023693.423962:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789023693.424057:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789023693.424069:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f4159450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+14:2362:x1875927007071488:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023693.424077:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023693.424088:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65f6d07000/0xc3c1fcbfb3417e64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf90e expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023693.424105:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023693.424159:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f4159450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+13:2362:x1875927007071488:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 94us (2103us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023693.424166:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00010000:00010000:3.0:1789023693.424916:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713c800/0xc3c1fcbfb3417c7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf843 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023693.424930:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023693.424967:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:2362:x1875927007071232:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 1024us (3021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023693.424975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:0.0:1789023693.425971:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023693.426079:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007071360 00000100:00100000:1.0:1789023693.426088:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007071360 00000100:00100000:3.0:1789023693.426154:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007071616 00000100:00100000:3.0:1789023693.426158:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007071616 00000100:00100000:3.0:1789023693.426214:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:3.0:1789023693.426223:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2360:x1875927007071616:12345-192.168.203.48@tcp:9:umount.0 00000020:00000080:3.0:1789023693.426248:0:6694:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417f52 00000100:00080000:3.0:1789023693.426257:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8e65f6c50800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789023693.426291:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789023693.426592:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+2:2360:x1875927007071616:12345-192.168.203.48@tcp:9:umount.0 Request processed in 369us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023693.426599:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 72 00000100:00100000:2.0:1789023693.427444:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1789023693.427460:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c318e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+11:2362:x1875927007071360:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023693.427472:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023693.427504:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c1668400/0xc3c1fcbfb3417be0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf80b expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023693.427533:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023693.427660:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789023693.427669:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789023693.428068:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c318e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2362:x1875927007071360:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 614us (4443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023693.428076:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:0.0:1789023693.441391:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023693.441704:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007072000 00000100:00100000:1.0:1789023693.441715:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007072000 00000100:00100000:1.0:1789023693.441789:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:1.0:1789023693.441801:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+7:2360:x1875927007072000:12345-192.168.203.48@tcp:9:umount.0 00000020:00000080:1.0:1789023693.441832:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb34181b3 00000020:00010000:1.0:1789023693.441840:0:6695:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e65ffdb3000: total 0 00000100:00080000:1.0:1789023693.441844:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8e65ffdb7000 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1789023693.442462:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:1.0:1789023693.443030:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1789023693.443345:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+5:2360:x1875927007072000:12345-192.168.203.48@tcp:9:umount.0 Request processed in 1543us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023693.443364:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000020:00010000:2.0:1789023693.444848:0:7645:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e65ffdb3000: total 0 00010000:00010000:2.0:1789023693.444904:0:7645:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e65ffdb3000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789023693.444956:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037a967ad/0xc3c1fcbfb3418be6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcaa expref: 4 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023693.444990:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7285453/0xc3c1fcbfb3418556 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfae3 expref: 3 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023693.445004:0:7645:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e65ffdb3000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789023693.445013:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023693.445015:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023693.445017:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023693.462518:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023693.462907:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007073024 00000100:00100000:1.0:1789023693.462918:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007073024 00000100:00100000:1.0:1789023693.463077:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 239 00000100:00100000:1.0:1789023693.463088:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+23:2360:x1875927007073024:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:1.0:1789023693.463136:0:5847:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417bee 00000020:00010000:1.0:1789023693.463155:0:5847:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e64c2fe0800: total 0 00000100:00080000:1.0:1789023693.463160:0:5847:0:(import.c:65:import_set_state_nolock()) ffff8e65d090a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789023693.463289:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:1.0:1789023693.463751:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fa0f4aba-40ac-42f8-b5d5-b35db811ced7+22:2360:x1875927007073024:12345-192.168.203.48@tcp:39:umount.0 Request processed in 663us (1271us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789023693.463760:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 239 00000020:00010000:0.0:1789023693.464222:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e64c2fe0800: total 0 00010000:00010000:0.0:1789023693.464265:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e64c2fe0800, canceled 0 locks, left on hash table 14. 00010000:00010000:0.0:1789023693.464298:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023693.464302:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789023693.464312:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06600/0xc3c1fcbfb3418517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bface expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464331:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023693.464333:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789023693.464337:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06400/0xc3c1fcbfb3418541 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfadc expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464350:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023693.464375:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789023693.464381:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05200/0xc3c1fcbfb3418bc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc9c expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464399:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023693.464402:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789023693.464406:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05c00/0xc3c1fcbfb3418b99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc95 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464417:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:0.0:1789023693.464419:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023693.464422:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707f200/0xc3c1fcbfb34185aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaf8 expref: 17 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464438:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023693.464440:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789023693.464444:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707e800/0xc3c1fcbfb3418215 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa0a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464455:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e65f41d1c00) 00010000:00010000:0.0:1789023693.464458:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023693.464461:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3417eb8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf91c expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464863:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e65eea05c00) 00010000:00010000:0.0:1789023693.464867:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789023693.464872:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3418437 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfa96 expref: 14 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464905:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e65c8ebd200) 00010000:00010000:0.0:1789023693.464908:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789023693.464912:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04a00/0xc3c1fcbfb3417f28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf938 expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464928:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023693.464930:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789023693.464934:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb3418bd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfca3 expref: 12 pid: 7654 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464957:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023693.464959:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789023693.464964:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707ea00/0xc3c1fcbfb34185c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfaff expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464978:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65c6960d00) 00010000:00010000:0.0:1789023693.464980:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023693.464984:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713da00/0xc3c1fcbfb3417ed4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf923 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.464998:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:0.0:1789023693.465000:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789023693.465003:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fe00/0xc3c1fcbfb34188a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfbd1 expref: 9 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.465015:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e65f41d1600) 00010000:00010000:0.0:1789023693.465018:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789023693.465028:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05400/0xc3c1fcbfb3418ac7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfc5d expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023693.465042:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e64c2fe0800, canceled 14 locks, left on hash table 0. 00010000:00010000:0.0:1789023693.465058:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023693.465060:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023693.465062:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023694.091276:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789023694.446254:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:0.0:1789023694.446262:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e65f6c54000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:1.0:1789023694.446355:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f6c54000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 for lustre-OST0001 00000020:00000080:1.0:1789023694.446405:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65f6c50800 for lustre-OST0001 00000100:00100000:3.0:1789023694.828727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023694.828810:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023694.829018:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007073280 00000100:00100000:2.0:1789023694.829029:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007073280 00000100:00100000:2.0:1789023694.829103:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00100000:2.0:1789023694.829116:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:2364:x1875927007073280:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:2.0:1789023694.829188:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:2364:x1875927007073280:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 77us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023694.829194:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 155 00000100:00080000:1.0:1789023694.829890:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023694.829957:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007073152 00000100:00100000:0.0:1789023694.829963:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007073152 00000100:00100000:0.0:1789023694.829995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 294 00000100:00100000:0.0:1789023694.830002:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2364:x1875927007073152:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023694.830320:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2364:x1875927007073152:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 316us (1600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023694.830328:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 294 00000100:00100000:1.0:1789023694.858076:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024875904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023694.858157:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023694.858345:0:8113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024875904 00000100:00100000:3.0:1789023694.858353:0:8113:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024875904 00000100:00100000:3.0:1789023694.858420:0:8113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789023694.858430:0:8113:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024875904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789023694.858494:0:8113:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023694.858547:0:8113:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d2780a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024875904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023694.858554:0:8113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789023694.858630:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6f50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024875904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789023694.858980:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789023695.113931:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023695.199727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023695.199843:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007073536 00000100:00100000:1.0:1789023695.199853:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007073536 00000100:00100000:1.0:1789023695.199925:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:1.0:1789023695.199936:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2364:x1875927007073536:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023695.199951:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023695.199970:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e707e400/0xc3c1fcbfb3417cc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf882 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023695.199987:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023695.200054:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:2364:x1875927007073536:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 119us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023695.200062:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789023695.205139:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023695.205212:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023695.209221:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023695.212880:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007073408 00000100:00100000:1.0:1789023695.212894:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007073408 00000100:00100000:1.0:1789023695.212978:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007073664 00000100:00100000:1.0:1789023695.212980:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007073664 00000100:00100000:1.0:1789023695.213045:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:1.0:1789023695.213055:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+10:2361:x1875927007073408:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023695.213070:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023695.213088:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713c000/0xc3c1fcbfb3417cc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf858 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023695.213103:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023695.213161:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6f50700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+9:2361:x1875927007073408:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 108us (8041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023695.213169:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:1.0:1789023695.213184:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:1.0:1789023695.213190:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+8:2361:x1875927007073664:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023695.213197:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023695.213205:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3417e5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf907 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023695.213214:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023695.213227:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0073100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+7:2361:x1875927007073664:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 38us (8017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023695.213233:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:0.0:1789023695.214030:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007073920 00000100:00100000:0.0:1789023695.214037:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007073920 00000100:00100000:0.0:1789023695.214074:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 240 00000100:00100000:0.0:1789023695.214081:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+6:2360:x1875927007073920:12345-192.168.203.48@tcp:39:umount.0 00000020:00000080:0.0:1789023695.214112:0:5846:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417cd5 00000020:00010000:0.0:1789023695.216948:0:5846:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e65f6c57800: total 0 00000100:00080000:0.0:1789023695.216961:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8e65f6c56000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789023695.216996:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:0.0:1789023695.217241:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ae515dcf-9b63-4da3-9356-8fdb8dd01002+5:2360:x1875927007073920:12345-192.168.203.48@tcp:39:umount.0 Request processed in 3156us (8026us total) trans 4294967528 rc 0/0 00000100:00100000:0.0:1789023695.217265:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 240 00000020:00010000:0.0:1789023695.217356:0:7645:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e65f6c57800: total 0 00010000:00010000:0.0:1789023695.217396:0:7645:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e65f6c57800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789023695.217427:0:7645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65eea05e00) 00010000:00010000:0.0:1789023695.217431:0:7645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023695.217440:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e707fa00/0xc3c1fcbfb3418bf4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcb1 expref: 4 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023695.217461:0:7645:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e65f6c57800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789023695.217471:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023695.217474:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023695.217493:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023695.238757:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023695.238865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007074176 00000100:00100000:1.0:1789023695.238876:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007074176 00000100:00100000:1.0:1789023695.238938:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 295 00000100:00100000:1.0:1789023695.238947:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+7:2360:x1875927007074176:12345-192.168.203.48@tcp:251:umount.0 00000020:00000080:1.0:1789023695.238993:0:5839:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417bcb 00000020:00010000:1.0:1789023695.239012:0:5839:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e65f7953000: total 0 00000100:00080000:1.0:1789023695.239016:0:5839:0:(import.c:65:import_set_state_nolock()) ffff8e65f7954800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789023695.239078:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0960450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96+3:2360:x1875927007074176:12345-192.168.203.48@tcp:251:umount.0 Request processed in 132us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023695.239086:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 295 00000020:00010000:0.0:1789023695.239364:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e65f7953000: total 0 00010000:00010000:0.0:1789023695.239368:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023695.239407:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e65f7953000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789023695.239435:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fce00/0xc3c1fcbfb3417c81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bf84a expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023695.239448:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e65f7953000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789023695.239455:0:5834:0:(genops.c:885:class_export_put()) final put ffff8e65f7953000/6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96 00010000:00010000:0.0:1789023695.239471:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023695.239473:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023695.239474:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789023695.240095:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f7953000/6e52d9d8-2fd2-4bd8-8fdf-c4a87c16ca96 for MGS 00000020:00000080:1.0:1789023695.240155:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65f7954800 for MGS 00010000:00010000:0.0:1789023696.139951:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023696.908191:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024876160:0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.908258:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023696.908325:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024876672:0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.908349:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023696.908380:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789023696.908391:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024876032:0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.908420:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023696.908444:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024876544:0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.908469:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023696.908521:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024876288:0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.908550:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023696.908578:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023696.908584:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024876416:0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.908609:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023696.908637:0:7654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876160 00000100:00100000:2.0:1789023696.908645:0:7654:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876160 00000100:00100000:2.0:1789023696.909429:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876672 00000100:00100000:2.0:1789023696.909435:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876672 00000100:00100000:2.0:1789023696.909507:0:7164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876416 00000100:00100000:2.0:1789023696.909511:0:7164:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876416 00000100:00100000:2.0:1789023696.909536:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789023696.909546:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024876672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.909619:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024876672:12345-0@lo:400:kworker.0 Request processed in 74us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023696.909626:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789023696.909641:0:7164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789023696.909647:0:7164:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024876416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.909676:0:7164:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024876416:12345-0@lo:400:kworker.0 Request processed in 30us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023696.909692:0:7164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789023696.909723:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876032 00000100:00100000:2.0:1789023696.909726:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876032 00000100:00100000:2.0:1789023696.909751:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789023696.909757:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024876032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.909786:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d0963c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3313:x1875927024876032:12345-0@lo:400:kworker.0 Request processed in 30us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023696.909792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1789023696.909819:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876544 00000100:00100000:2.0:1789023696.909822:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876544 00000100:00100000:2.0:1789023696.909847:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876288 00000100:00100000:2.0:1789023696.909850:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876288 00000100:00100000:2.0:1789023696.909863:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789023696.909868:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024876544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.909897:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024876544:12345-0@lo:400:kworker.0 Request processed in 28us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023696.909903:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789023696.909914:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789023696.909919:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024876288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023696.909944:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024876288:12345-0@lo:400:kworker.0 Request processed in 26us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023696.909949:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:2.0:1789023696.909971:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789023696.909975:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789023696.909976:0:5841:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023696.917002:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024876416:0@lo:400:kworker.0 00000100:00100000:0.0:1789023696.917019:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024876288:0@lo:400:kworker.0 00000100:00100000:0.0:1789023696.917103:0:7654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789023696.917112:0:7654:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e74bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024876160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023696.917189:0:7654:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e74bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024876160:12345-0@lo:400:kworker.0 Request processed in 78us (8930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023696.917202:0:7654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789023696.917235:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2478a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024876032:0@lo:400:kworker.0 00000100:00100000:0.0:1789023696.917248:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024876544:0@lo:400:kworker.0 00000100:00100000:0.0:1789023696.917258:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024876160:0@lo:400:kworker.0 00000100:00100000:0.0:1789023696.917269:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024876672:0@lo:400:kworker.0 00000001:00100000:0.0:1789023696.949863:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000001:00080000:0.0:1789023696.949881:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789023696.949886:0:5867:0:(genops.c:885:class_export_put()) final put ffff8e65f6c57800/ae515dcf-9b63-4da3-9356-8fdb8dd01002 00000001:00100000:0.0:1789023696.949928:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000001:00080000:0.0:1789023696.949936:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789023696.949950:0:5867:0:(genops.c:885:class_export_put()) final put ffff8e64c2fe0800/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:1.0:1789023696.950602:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f6c57800/ae515dcf-9b63-4da3-9356-8fdb8dd01002 for lustre-MDT0000 00000020:00000080:1.0:1789023696.950658:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c2fe0800/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 for lustre-MDT0000 00000020:00000080:1.0:1789023696.950690:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65f6c56000 for lustre-MDT0000 00000020:00000080:1.0:1789023696.950694:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65d090a000 for lustre-MDT0000 00000001:00100000:3.0:1789023696.982286:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:3.0:1789023696.982295:0:6722:0:(genops.c:885:class_export_put()) final put ffff8e65ffdb3000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 00000020:00000080:2.0:1789023696.987224:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65ffdb3000/fa0f4aba-40ac-42f8-b5d5-b35db811ced7 for lustre-OST0000 00000020:00000080:2.0:1789023696.987281:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65ffdb7000 for lustre-OST0000 00000020:01000004:3.0:1789023697.056964:0:12938:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789023697.067590:0:12938:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789023697.067638:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.067652:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.067659:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.067667:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.067692:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789023697.067696:0:12938:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789023697.067723:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789023697.067728:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789023697.067734:0:12938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789023697.067757:0:12938:0:(import.c:65:import_set_state_nolock()) ffff8e65c35a4800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1789023697.070628:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023697.070642:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023697.070654:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fda00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023697.070658:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023697.070668:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023697.070675:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023697.070695:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789023697.070698:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789023697.070701:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789023697.070744:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023697.070751:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023697.070833:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023697.070841:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fda00/0xc3c1fcbfb3417c50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c57 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023697.070886:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024876800:0@lo:39:umount.0 00000100:00100000:2.0:1789023697.070954:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023697.071019:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024876928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023697.071043:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023697.071097:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876800 00000100:00100000:2.0:1789023697.071105:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876800 00000100:00100000:2.0:1789023697.071149:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789023697.071158:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875927024876800:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789023697.071180:0:5846:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb34179da 00000100:00080000:2.0:1789023697.071189:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8e65c9b2d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789023697.071242:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1875927024876800:12345-0@lo:39:umount.0 Request processed in 85us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023697.071250:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789023697.071256:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024876928 00000020:00000080:2.0:1789023697.071259:0:5846:0:(genops.c:885:class_export_put()) final put ffff8e65c9b2d000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:1.0:1789023697.071263:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024876928 00010000:00010000:2.0:1789023697.071287:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023697.071307:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789023697.071315:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65c35a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789023697.071317:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3310:x1875927024876928:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023697.071328:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024876800:0@lo:39:umount.0 00010000:00010000:1.0:1789023697.071330:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023697.071347:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c1668000/0xc3c1fcbfb3417c57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c50 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789023697.071353:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c9b2d000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00010000:00010000:1.0:1789023697.071363:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:2.0:1789023697.071396:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65c9b2d800 for lustre-MDT0000 00000100:00100000:1.0:1789023697.071404:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+18:3310:x1875927024876928:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023697.071412:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789023697.071422:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024876928:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789023697.071439:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789023697.071443:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789023697.071447:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789023697.071551:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023697.071562:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023697.071564:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023697.072742:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.072757:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.072764:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.072772:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.072840:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789023697.072848:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.072856:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.072862:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.072869:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077051:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789023697.077079:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023697.077088:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077099:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c1668800 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023697.077103:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077122:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023697.077130:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023697.077136:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789023697.077154:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789023697.077191:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077198:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023697.077227:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077235:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668800/0xc3c1fcbfb3417c5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077254:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023697.077258:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077265:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05600 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023697.077268:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077276:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023697.077282:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023697.077289:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789023697.077291:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789023697.077295:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789023697.077314:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077320:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023697.077346:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05600/0xc3c1fcbfb3417b85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417b8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077374:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023697.077377:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023697.077381:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023697.077400:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024877184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789023697.077463:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789023697.077584:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077593:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077600:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077607:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077624:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789023697.077632:0:12938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077639:0:12938:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077656:0:12938:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077662:0:12938:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.077679:0:12938:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789023697.077684:0:12938:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789023697.077687:0:12938:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789023697.078011:0:12938:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789023697.078016:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789023697.078023:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023697.078030:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789023697.078037:0:12938:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e65e77ac800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789023697.078044:0:12938:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8e65dddea000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789023697.078049:0:12938:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8e65d0718000) has exports, disconnecting them 00000020:00080000:0.0:1789023697.078055:0:12938:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e65e77ac800), last request at 1789023696 00000020:00000080:0.0:1789023697.078062:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417b4d 00000100:00080000:0.0:1789023697.078086:0:12938:0:(import.c:65:import_set_state_nolock()) ffff8e65e77ae800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789023697.078187:0:12938:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e65e77ac800): rc 0 00000020:00000080:0.0:1789023697.078190:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65e77ac800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789023697.078205:0:12938:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e65dddea000), last request at 1789023696 00000020:00000080:0.0:1789023697.078210:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417a74 00000100:00080000:0.0:1789023697.078219:0:12938:0:(import.c:65:import_set_state_nolock()) ffff8e65dddea800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789023697.078234:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023697.078241:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078260:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f000 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023697.078264:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078272:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023697.078279:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023697.078285:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789023697.078288:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789023697.078291:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789023697.078315:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078321:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023697.078338:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078345:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e707f000/0xc3c1fcbfb3417e87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417e8e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078357:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023697.078361:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078367:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04c00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023697.078369:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078382:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023697.078388:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023697.078393:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789023697.078395:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789023697.078398:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789023697.078414:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078419:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023697.078428:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078434:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04c00/0xc3c1fcbfb3417939 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417940 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.078451:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023697.078454:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023697.078457:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023697.078470:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024877312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789023697.078534:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789023697.078600:0:12938:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e65dddea000): rc 0 00000020:00000080:0.0:1789023697.078603:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65dddea000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1789023697.078610:0:12938:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9c3b4466fae0 00000100:00080000:0.0:1789023697.078628:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789023697.078632:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1789023697.078654:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1789023697.079300:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023697.079318:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024877184 00000100:00100000:2.0:1789023697.079326:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024877184 00000100:00080000:0.0:1789023697.079378:0:12938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789023697.079400:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024877312 00000100:00080000:0.0:1789023697.079402:0:12938:0:(import.c:65:import_set_state_nolock()) ffff8e64c13a7000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789023697.079404:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024877312 00000100:00080000:0.0:1789023697.079421:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789023697.079424:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1789023697.079438:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789023697.079442:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023697.079454:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+19:3312:x1875927024877184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789023697.079499:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023697.079516:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713c400/0xc3c1fcbfb3417b8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417b85 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789023697.079533:0:12938:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00010000:00010000:2.0:1789023697.079534:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1789023697.079545:0:12938:0:(import.c:65:import_set_state_nolock()) ffff8e65e77af800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789023697.079589:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e65d0718000) has no exports 00000100:00100000:2.0:1789023697.079600:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2478a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+18:3312:x1875927024877184:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023697.079608:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023697.079626:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789023697.079632:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f415b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:3313:x1875927024877312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789023697.079639:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023697.079648:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3417e8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e87 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023697.079657:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023697.079690:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f415b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3313:x1875927024877312:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023697.079696:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789023697.079759:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2478380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72bd38e6-1e7e-4158-85a3-542824dd2807:3312:1875927024877184:0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1789023697.079843:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65e77ac800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789023697.079882:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65dddea000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789023697.079902:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65e77ae800 for lustre-MDT0000 00000020:00000080:2.0:1789023697.079907:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65dddea800 for lustre-MDT0000 00010000:00010000:2.0:1789023697.079916:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023697.079929:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024877440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023697.079959:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023697.079971:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72bd38e6-1e7e-4158-85a3-542824dd2807:3313:1875927024877312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023697.079992:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023697.080000:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024877056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023697.080020:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023697.080048:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024877440 00000100:00100000:2.0:1789023697.080052:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024877440 00000100:00100000:2.0:1789023697.080070:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024877056 00000100:00100000:2.0:1789023697.080073:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024877056 00000100:00100000:2.0:1789023697.080837:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789023697.080855:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+17:3310:x1875927024877440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789023697.080867:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023697.080881:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fd000/0xc3c1fcbfb3417940 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417939 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023697.080897:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023697.080941:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3310:x1875927024877440:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023697.081351:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1789023697.081606:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023697.081977:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024877568:0@lo:9:umount.0 00000100:00100000:3.0:1789023697.082025:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023697.082077:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024877696:0@lo:9:umount.0 00000100:00100000:0.0:1789023697.082200:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024877568 00000100:00100000:0.0:1789023697.082207:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024877568 00000100:00100000:0.0:1789023697.082253:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789023697.082262:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875927024877568:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789023697.082286:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417ac8 00000100:00080000:0.0:1789023697.082297:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8e65d090d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789023697.082330:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1789023697.082413:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789023697.082456:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023697.084036:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1875927024877568:12345-0@lo:9:umount.0 Request processed in 1436us (1670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023697.084049:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789023697.084070:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024877696 00000100:00100000:0.0:1789023697.084076:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024877696 00000100:00100000:0.0:1789023697.084186:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789023697.084326:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875927024877696:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789023697.084350:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417bc4 00000100:00080000:0.0:1789023697.084361:0:6695:0:(import.c:65:import_set_state_nolock()) ffff8e65d090c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789023697.084401:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789023697.084844:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1875927024877696:12345-0@lo:9:umount.0 Request processed in 649us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023697.084851:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1789023697.084876:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023697.085729:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+16:3310:x1875927024877056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789023697.085866:0:6710:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023697.085889:0:6710:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04000/0xc3c1fcbfb3417c65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c5e expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023697.085905:0:6710:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023697.085948:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72bd38e6-1e7e-4158-85a3-542824dd2807+15:3310:x1875927024877056:12345-0@lo:103:ldlm_bl.0 Request processed in 4589us (5926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023697.085957:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789023697.090782:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1789023697.090837:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023697.090879:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024877056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023697.090892:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024877440:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789023697.090992:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e64c13a7000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789023697.091016:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789023697.091018:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789023697.091022:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024877568:0@lo:9:umount.0 00000100:00080000:3.0:1789023697.091034:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e77af800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789023697.091052:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789023697.091053:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789023697.091074:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024877696:0@lo:9:umount.0 00000020:00080000:0.0:1789023697.098957:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8e65d0718000) has no exports 00010000:00010000:3.0:1789023697.161787:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789023697.196133:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417994 00000020:00000080:0.0:1789023697.196149:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c903c000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789023697.196167:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789023697.196238:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c903c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789023697.196261:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789023697.196270:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789023697.196275:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8e65d27219c0) has no exports 00000020:00000080:1.0:1789023697.196601:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb341798d 00000020:00000080:1.0:1789023697.196607:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65f79b4800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789023697.196661:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789023697.196669:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789023697.196671:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65f79b5000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789023697.196674:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f79b5000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789023697.196678:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789023697.196856:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f79b4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789023697.196942:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e65ddc7cc00 - data ffff8e65db426948/ffff8e65e778c800 00000020:01000000:1.0:1789023697.197125:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e65f4117780 - data ffff8e65db40daf8/ffff8e65f79c3000 00000001:00000004:2.0:1789023697.229726:0:12938:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1789023697.320049:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789023697.320057:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1789023697.320069:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789023697.320071:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789023697.320607:0:6846:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789023697.320622:0:6846:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:1.0:1789023697.320632:0:6846:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789023697.321534:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789023697.321540:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789023697.321565:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789023697.321567:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789023697.321963:0:8106:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789023697.321966:0:8106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:1.0:1789023697.321977:0:8106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1789023697.397633:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb341795c 00000020:00000080:0.0:1789023697.397646:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c35a5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789023697.397759:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c35a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789023697.398715:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417971 00000020:00000080:0.0:1789023697.398722:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65e6d8e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789023697.398737:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789023697.398743:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023697.398751:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789023697.398755:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8e65d071b380) has no exports 00000020:00000080:1.0:1789023697.398853:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65e6d8e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:0.0:1789023697.398900:0:12938:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789023697.398908:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417baf 00000020:00000080:0.0:1789023697.398912:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65f7957800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789023697.398922:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789023697.398931:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023697.398936:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789023697.398938:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8e65f0044d40) has no exports 00000020:00000080:0.0:1789023697.398943:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417ba8 00000020:00000080:0.0:1789023697.398947:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65e77ae000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789023697.399096:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f7957800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789023697.399105:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65e77ae000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789023697.399251:0:12938:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789023697.399256:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789023697.399260:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789023697.399265:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789023697.399267:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789023697.399303:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023697.399309:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789023697.399314:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417aba 00000020:00000080:0.0:1789023697.399318:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65e7027800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789023697.399321:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789023697.399324:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023697.399327:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789023697.399329:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8e65d2723380) has no exports 00000020:00000080:0.0:1789023697.399332:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417ab3 00000020:00000080:0.0:1789023697.399334:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e64c13a3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789023697.399577:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65e77af800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789023697.399585:0:8:0:(genops.c:885:class_export_put()) final put ffff8e65f7950800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789023697.399588:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65f7950800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789023697.399594:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:01000000:0.0:1789023697.399771:0:12938:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789023697.399775:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789023697.399777:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789023697.399780:0:12938:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789023697.399782:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789023697.399817:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023697.399822:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789023697.399845:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023697.399847:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789023697.399851:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c35a1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789023697.399853:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c35a1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789023697.399856:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789023697.399879:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65e7027800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789023697.399888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c13a3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789023697.399897:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e64c13a7000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789023697.399902:0:8:0:(genops.c:885:class_export_put()) final put ffff8e64c13a1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789023697.399905:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c13a1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789023697.399911:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789023697.400009:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417978 00000020:00000080:0.0:1789023697.400016:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65e6d8c800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789023697.400030:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789023697.400032:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65e6d8c800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789023697.400034:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023697.400040:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789023697.400043:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8e65d07199c0) has no exports 00000020:00000080:0.0:1789023697.400065:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023697.400069:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789023697.400072:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c35a3000/lustre-MDD0000_UUID 00000020:00000080:0.0:1789023697.400074:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c35a3000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789023697.400078:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:0.0:1789023697.400214:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb341797f 00000020:00000080:0.0:1789023697.400219:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65e6d8b000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789023697.400235:0:12938:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65d252c800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789023697.400238:0:12938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65d252c800 3 00000020:01000004:0.0:1789023697.400241:0:12938:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e65d252c800 from lustre-MDT0000 00000020:00000080:0.0:1789023697.400256:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023697.400260:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789023697.400262:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c35a4000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789023697.400264:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c35a4000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789023697.400270:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789023697.400290:0:12938:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789023697.400294:0:12938:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789023697.400296:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789023697.400299:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023697.400301:0:12938:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789023697.400307:0:12938:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8e65d26f8000 72bd38e6-1e7e-4158-85a3-542824dd2807 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789023697.400312:0:12938:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8e65c85a0000) has exports, disconnecting them 00000020:00080000:0.0:1789023697.400316:0:12938:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e65d26f8000), last request at 1789023490 00000020:00000080:0.0:1789023697.400329:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb341791d 00000020:00010000:0.0:1789023697.400333:0:12938:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8e65d26f8000: total 1 00000100:00080000:0.0:1789023697.400337:0:12938:0:(import.c:65:import_set_state_nolock()) ffff8e65d26fd000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789023697.400355:0:12938:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e65d26f8000): rc 0 00000020:00080000:0.0:1789023697.400359:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8e65c85a0000) has no exports 00000020:00000080:3.0:1789023697.400389:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65e6d8b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:1.0:1789023697.400566:0:5834:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8e65d26f8000: total 0 00000100:00100000:2.0:1789023697.400585:0:5838:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e65d0995000:5838] 0 exiting: rc = 1 00010000:00010000:1.0:1789023697.400592:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8e65d26f8000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789023697.400620:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65f6d06800/0xc3c1fcbfb3417e80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e79 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.400640:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fd600/0xc3c1fcbfb3417c2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c26 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.400652:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c1669200/0xc3c1fcbfb3417c1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c18 expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023697.400673:0:5840:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e65d0994600:5840] 2 exiting: rc = 0 00010000:00010000:1.0:1789023697.401141:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65d71fd800/0xc3c1fcbfb3417c3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c34 expref: 6 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.401151:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713ca00/0xc3c1fcbfb3417c49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c42 expref: 5 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.401160:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3417e72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417e6b expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.401173:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e6602167a00/0xc3c1fcbfb3417a27 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417a20 expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.401185:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c1669a00/0xc3c1fcbfb3417c73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc3c1fcbfb3417c6c expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023697.401195:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8e65d26f8000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789023697.401211:0:5834:0:(genops.c:885:class_export_put()) final put ffff8e65d26f8000/72bd38e6-1e7e-4158-85a3-542824dd2807 00010000:00010000:1.0:1789023697.402813:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023697.402820:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023697.402823:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023697.402866:0:5839:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e65d0994e00:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1789023697.404796:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404810:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404817:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404823:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404829:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404836:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404843:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404849:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404854:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404860:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404866:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404870:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404876:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404882:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404887:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404892:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404899:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404904:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404909:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404914:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404920:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404926:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404932:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404937:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404942:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404947:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404952:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404957:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404963:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404969:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404974:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404980:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.404985:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405012:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405018:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405023:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405029:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405034:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405041:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405046:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405051:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405057:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405062:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405068:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405073:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405079:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405084:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405090:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405095:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405100:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.405106:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789023697.406211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d26f8000/72bd38e6-1e7e-4158-85a3-542824dd2807 for MGS 00000100:00100000:0.0:1789023697.406247:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406255:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406260:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406268:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406274:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406280:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406285:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406290:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406296:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406303:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406310:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406317:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.406322:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789023697.409765:0:12938:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789023697.409772:0:12938:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:3.0:1789023697.410871:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65d26fd000 for MGS 00000020:01000000:3.0:1789023697.411847:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e65f698da80 - data ffff8e65f13b7e58/ffff8e65f6c5fc00 00000020:01000000:3.0:1789023697.411967:0:12938:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e65c4c36240 - data ffff8e65f13b86c0/ffff8e65c2f86400 00000020:00000080:3.0:1789023697.412408:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417901 00000020:00000080:3.0:1789023697.412416:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65d234e800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789023697.412438:0:12938:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65d252c800 from MGS, refs=2 00000020:01000004:3.0:1789023697.412442:0:12938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65d252c800 2 00000020:01000004:3.0:1789023697.412445:0:12938:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e65d252c800 from MGS 00000020:00000080:3.0:1789023697.412464:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789023697.412470:0:12938:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789023697.412473:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65d234d800/MGS 00000020:00000080:3.0:1789023697.412498:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d234d800/MGS for MGS 00000020:01000000:3.0:1789023697.412505:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789023697.412565:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789023697.412569:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789023697.412575:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789023697.412581:0:12938:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e65c35a0800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789023697.412587:0:12938:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8e65f0043380) has exports, disconnecting them 00000020:00080000:3.0:1789023697.412592:0:12938:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e65c35a0800), last request at 1789023491 00000020:00000080:3.0:1789023697.412607:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb34179cc 00000020:00080000:3.0:1789023697.412617:0:12938:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e65c35a0800): rc 0 00000020:00000080:3.0:1789023697.412621:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c35a0800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789023697.413609:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d234e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789023697.413621:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c35a0800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789023697.442563:0:12938:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789023697.442572:0:12938:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789023697.442577:0:12938:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789023697.442584:0:12938:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789023697.442731:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65c35a4800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789023697.442772:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789023697.442787:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1789023697.442793:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c35a7000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1789023697.442796:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c35a7000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1789023697.442804:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789023697.442861:0:12938:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65d252c800 1 00000020:00000080:1.0:1789023697.442867:0:12938:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb34178f3 00000020:00000080:1.0:1789023697.442873:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65d234b000/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789023697.442889:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789023697.442893:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789023697.442897:0:12938:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789023697.442901:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8e65d071cd40) has no exports 00000020:00000080:0.0:1789023697.443211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d234b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789023697.536116:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023697.536131:0:12938:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789023697.536149:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65c7ea5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789023697.536154:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c7ea5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789023697.536162:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789023697.536295:0:12938:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e65d252c000 00000020:01000000:0.0:1789023697.536324:0:12938:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789023697.536328:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023697.536333:0:12938:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789023697.536340:0:12938:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8e65d278cd40) has no exports 00000100:00100000:0.0:1789023697.536456:0:5845:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8e65d2712600:5845] 0 exiting: rc = 1 00000100:00100000:2.0:1789023697.536652:0:5846:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8e65d2713a00:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1789023697.536667:0:7654:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8e65e77bb800:7654] 3 exiting: rc = 0 00000100:00100000:2.0:1789023697.536734:0:5847:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8e65d2712800:5847] 2 exiting: rc = 0 00000100:00100000:0.0:1789023697.537185:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537194:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537199:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537205:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537211:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537216:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537222:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537227:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537232:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537238:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537244:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537249:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537253:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537258:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537264:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537269:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537273:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537278:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537283:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537288:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537293:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537297:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537303:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537308:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537313:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537329:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537334:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537340:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537345:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537351:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537357:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537363:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537367:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537372:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537378:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537383:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537388:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537394:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537400:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537405:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537410:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537414:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537420:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537425:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537430:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537436:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537442:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537448:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537453:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537458:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537462:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537467:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537472:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537495:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537500:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537505:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537510:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537516:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537522:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537527:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537541:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537546:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537560:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.537567:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789023697.544239:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e65d0818200:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1789023697.544393:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e65d0984200:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1789023697.544638:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544646:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544652:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544658:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544663:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544669:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544678:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544685:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544690:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544696:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544703:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544709:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544715:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544719:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544724:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544728:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544732:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544737:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544742:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544747:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544751:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544756:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544760:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544765:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544770:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544775:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544781:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544786:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544791:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544795:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544800:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544817:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544822:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544828:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544833:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544837:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544842:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544849:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544853:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544856:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544861:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544865:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544869:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544874:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544878:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544882:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544887:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544892:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544896:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544901:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544905:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544909:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544913:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544919:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544924:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544929:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544934:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544939:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544944:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544948:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544953:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544958:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544963:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.544968:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789023697.545634:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8e65d2745600:5850] 0 exiting: rc = 1 00000100:00100000:1.0:1789023697.545861:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8e65d2745000:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1789023697.545941:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.545948:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.545961:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.545966:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.545972:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.545978:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.545994:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546000:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546006:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546014:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546022:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546028:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546034:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546056:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546063:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546068:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546073:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546079:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546088:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546093:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546098:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546104:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546108:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546113:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546118:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546138:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546144:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546149:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546154:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546159:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546165:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546169:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546174:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546179:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546185:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546190:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546194:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546231:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546238:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546243:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546248:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546253:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546258:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546263:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546268:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546273:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546278:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546282:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546287:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546305:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546311:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546316:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546322:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546327:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546332:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546337:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546344:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546351:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546357:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546373:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546379:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546385:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546390:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.546395:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789023697.553585:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e65d2745a00:5853] 1 exiting: rc = 0 00000100:00100000:0.0:1789023697.553836:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e65d2744600:5852] 0 exiting: rc = 1 00000100:00100000:1.0:1789023697.554247:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554255:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554260:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554264:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554270:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554275:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554280:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554285:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554290:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554295:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554300:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554305:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554309:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554313:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554318:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554324:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554329:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554333:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554338:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554354:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554359:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554364:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554369:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554374:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554379:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554383:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554388:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554393:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554397:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554402:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554407:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554411:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554416:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554421:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554426:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554431:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554436:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554442:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554448:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554453:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554457:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554462:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554467:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554472:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554664:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554672:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554677:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554683:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554687:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554692:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554697:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554702:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554707:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554712:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554724:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554729:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554734:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554738:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554743:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554748:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554752:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554757:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554762:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.554767:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789023697.555285:0:5854:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e65d2744200:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1789023697.555720:0:5855:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e65d09d8e00:5855] 1 exiting: rc = 0 00000100:00100000:0.0:1789023697.555808:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555813:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555819:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555824:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555829:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555834:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555838:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555852:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555858:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555862:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555868:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555872:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555877:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555882:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555887:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555892:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555897:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555901:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555906:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555910:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555915:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555920:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555925:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555930:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555935:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555940:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555945:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555949:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555954:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555959:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555965:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555969:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.555974:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556042:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556053:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556058:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556063:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556068:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556073:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556078:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556083:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556088:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556101:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556106:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556111:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556116:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556122:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556128:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556132:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556138:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556143:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556148:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556153:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556157:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556162:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556167:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556172:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556176:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556182:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556187:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556191:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556196:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556202:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.556206:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.556833:0:5856:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e65d2745200:5856] 0 exiting: rc = 1 00000100:00100000:3.0:1789023697.556923:0:5857:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e65d2745e00:5857] 1 exiting: rc = 0 00000100:00100000:0.0:1789023697.557091:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557102:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557107:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557112:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557116:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557120:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557125:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557130:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557136:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557143:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557148:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557153:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557157:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557171:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557176:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557181:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557185:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557190:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557195:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557200:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557204:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557209:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557215:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557220:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557225:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557230:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557234:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557239:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557243:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557248:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557252:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557257:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557261:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557266:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557271:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557276:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557280:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557285:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557290:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557296:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557300:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557305:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557309:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557314:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557319:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557323:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557328:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557333:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557344:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557348:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557353:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557358:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557362:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557366:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557370:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557375:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557380:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557385:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557390:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557394:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557398:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557403:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557407:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.557412:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023697.558279:0:5858:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8e65d2617e00:5858] 0 exiting: rc = 1 00000100:00100000:3.0:1789023697.558581:0:5859:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8e65d2616c00:5859] 1 exiting: rc = 0 00000100:00100000:0.0:1789023697.558813:0:5860:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8e65d1665e00:5860] 2 exiting: rc = 0 00000100:00100000:0.0:1789023697.558865:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558871:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558876:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558881:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558886:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558892:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558897:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558902:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558907:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558912:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558918:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558923:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558928:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558933:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558939:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558945:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558950:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.558955:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559055:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559065:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559070:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559076:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559082:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559088:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559093:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559098:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559104:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559109:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559114:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559120:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559126:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559131:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559138:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559144:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559149:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559154:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559159:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559164:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559170:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559175:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559181:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559187:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559208:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559215:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559220:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559226:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559231:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559235:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559241:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559246:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559251:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559256:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559261:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559274:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559279:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559283:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559289:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559294:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559301:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559306:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559312:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559318:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559323:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789023697.559328:0:12938:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789023697.563794:0:12938:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023697.563807:0:12938:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789023697.563813:0:12938:0:(genops.c:885:class_export_put()) final put ffff8e65d271a000/MDS_uuid 00000020:00000080:0.0:1789023697.563817:0:12938:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d271a000/MDS_uuid for MDS 00000020:01000000:0.0:1789023697.563823:0:12938:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789023697.563965:0:12938:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789023698.185631:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023699.214524:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789023699.494716:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789023699.494725:0:7659:0:(genops.c:885:class_export_put()) final put ffff8e65d090d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789023699.494809:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d090d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789023699.495121:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65d090c000 for lustre-OST0001 00000020:01000004:0.0:1789023699.947169:0:13089:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789023699.958654:0:13089:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789023699.958705:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023699.958733:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023699.958742:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023699.958749:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023699.958776:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789023699.958795:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789023699.958818:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789023699.958822:0:13089:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789023699.958828:0:13089:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789023699.958848:0:13089:0:(import.c:65:import_set_state_nolock()) ffff8e65dddeb000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789023699.958909:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875927024877824:0@lo:39:umount.0 00010000:00010000:1.0:1789023699.958932:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023699.958941:0:7644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023699.958951:0:7644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c1668200 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023699.958955:0:7644:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023699.958964:0:7644:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000400:00000100:2.0:1789023699.958965:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927024877824 offset 0 length 224: 4 10000000:00010000:1.0:1789023699.958978:0:7644:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023699.958984:0:7644:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789023699.958987:0:7644:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789023699.958990:0:7644:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789023699.959017:0:7644:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023699.959106:0:7644:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789023699.959138:0:7644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023699.959145:0:7644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668200/0xc3c1fcbfb3417c34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc3c1fcbfb3417c3b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023699.959156:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023699.959158:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023699.959159:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023699.959181:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023699.959192:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024877952:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023699.959227:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023699.959777:0:6710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024877952 00000100:00100000:1.0:1789023699.959786:0:6710:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024877952 00000100:00100000:1.0:1789023699.959826:0:6710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789023699.959832:0:6710:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875927024877952:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789023699.959839:0:6710:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789023699 with bad export cookie 14105833408177469725 00000100:00100000:1.0:1789023699.975168:0:6710:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3310:x1875927024877952:12345-0@lo:103:ldlm_bl.0 Request processed in 15320us (15926us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789023699.975182:0:6710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789023699.976329:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789023699.976335:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e65c3529000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789023699.976339:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789023699.987849:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.148@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789023699.987855:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789023699.987864:0:3310:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e65f6c94a80 x1875927024877952/t0(0) o103->MGC192.168.203.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789023715 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1789023699.987876:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789023699.987879:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789023699.987880:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789023699.987884:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e65c3529000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789023699.987888:0:3310:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 156 00000100:00080000:0.0:1789023699.987901:0:3310:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import ffff8e65c3529000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789023699.987933:0:3310:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f7983480 x1875927024878080/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789023699.988002:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72bd38e6-1e7e-4158-85a3-542824dd2807:3309:1875927024878080:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1789023699.988050:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875927024878080 offset 0 length 520: 4 00000100:00100000:0.0:1789023699.988181:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72bd38e6-1e7e-4158-85a3-542824dd2807:3310:1875927024877952:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023700.236966:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023701.258073:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789023702.025701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789023702.025712:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789023702.025817:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024878208:0@lo:400:kworker.0 00000400:00000100:0.0:1789023702.025871:0:3312:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927024878208 offset 0 length 224: 4 00000001:00100000:3.0:1789023702.077070:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789023702.077134:0:6722:0:(genops.c:885:class_export_put()) final put ffff8e65d0908000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789023702.077211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d0908000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789023702.077325:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65d090d000 for lustre-OST0000 00010000:00010000:2.0:1789023702.281640:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023703.305725:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023704.330634:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789023705.034239:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789023705.034247:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789023705.034338:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024878336:0@lo:400:kworker.0 00000400:00000100:2.0:1789023705.034450:0:3313:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927024878336 offset 0 length 224: 4 00010000:00010000:0.0:1789023705.353744:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023706.377642:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023707.402004:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023708.426108:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023709.193616:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789023699/real 1789023699] req@ffff8e65f7983480 x1875927024878080/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789023709 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023709.193649:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e65f7983480 x1875927024878080/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789023709 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023709.193659:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789023699/real 1789023699] req@ffff8e65f7981c00 x1875927024877824/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789023709 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023709.193672:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e65f7981c00 x1875927024877824/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789023709 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789023709.193725:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65c3529000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789023709.193746:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789023709.193750:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72bd38e6-1e7e-4158-85a3-542824dd2807:3309:1875927024878080:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1789023709.193756:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65dddeb000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789023709.193767:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875927024877824:0@lo:39:umount.0 00000100:00080000:1.0:1789023709.193883:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789023709.193889:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789023709.193892:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e65c3529000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789023709.193898:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 366 00000100:00080000:1.0:1789023709.193903:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789023709.193913:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import ffff8e65c3529000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789023709.193944:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f6c97b80 x1875927024878464/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789023709.194002:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789023709.194013:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024878592:0@lo:400:kworker.0 00000400:00000100:1.0:1789023709.194058:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927024878592 offset 0 length 224: 4 00000100:00100000:2.0:1789023709.194068:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72bd38e6-1e7e-4158-85a3-542824dd2807:3309:1875927024878464:0@lo:250:kworker.0 00000400:00000100:2.0:1789023709.194089:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875927024878464 offset 0 length 520: 4 00000100:00080000:0.0:1789023709.198132:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789023709.198140:0:13089:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789023709.198164:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789023709.199107:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199123:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199131:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199137:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199156:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789023709.199163:0:13089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199169:0:13089:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199175:0:13089:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199182:0:13089:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023709.199203:0:13089:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789023709.199207:0:13089:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789023709.199227:0:13089:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789023709.199231:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789023709.199236:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023709.199250:0:13089:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789023709.199254:0:13089:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e65f0040000) has no exports 00000020:00080000:0.0:1789023709.199277:0:13089:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8e65f0040000) has no exports 00010000:00010000:2.0:1789023709.199421:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023709.199429:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199436:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fc400 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:2.0:1789023709.199440:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199450:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023709.199457:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023709.199463:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789023709.199471:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1789023709.199616:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1789023709.199629:0:7645:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e65c3529000 00010000:00010000:2.0:1789023709.199633:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199640:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fc400/0xc3c1fcbfb3417c42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417c49 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199655:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023709.199658:0:7645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199664:0:7645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c600 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:2.0:1789023709.199667:0:7645:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199674:0:7645:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023709.199681:0:7645:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023709.199686:0:7645:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789023709.199688:0:7645:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789023709.199690:0:7645:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789023709.199693:0:7645:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e65c3529000 00010000:00010000:2.0:1789023709.199696:0:7645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199714:0:7645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3417e79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417e80 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023709.199778:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023709.199780:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023709.199782:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789023709.200933:0:13089:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e65f698d720 - data ffff8e65f12feaf8/ffff8e65f6c5e800 00000020:01000000:0.0:1789023709.201076:0:13089:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e64c22323c0 - data ffff8e65db6bb360/ffff8e65ffc4e400 00010000:00010000:1.0:1789023709.201416:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789023709.210379:0:13089:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789023709.256681:0:13089:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417a43 00000020:00000080:3.0:1789023709.256690:0:13089:0:(genops.c:885:class_export_put()) final put ffff8e65dddef000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789023709.256814:0:13089:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65d089d800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789023709.256819:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65d089d800 2 00000020:01000004:3.0:1789023709.256822:0:13089:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e65d089d800 from lustre-OST0000 00000020:00000080:3.0:1789023709.256859:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789023709.256868:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789023709.256871:0:13089:0:(genops.c:885:class_export_put()) final put ffff8e65dddee000/lustre-OST0000_UUID 00000020:00000080:3.0:1789023709.256874:0:13089:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65dddee000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789023709.256881:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789023709.256925:0:13089:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789023709.256930:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789023709.256933:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789023709.256938:0:13089:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789023709.256945:0:13089:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e64c13a6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789023709.256950:0:13089:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8e65f00419c0) has exports, disconnecting them 00000020:00080000:3.0:1789023709.256956:0:13089:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e64c13a6800), last request at 1789023507 00000020:00000080:3.0:1789023709.256960:0:13089:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417a6d 00000020:00080000:3.0:1789023709.256970:0:13089:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e64c13a6800): rc 0 00000020:00000080:3.0:1789023709.256976:0:13089:0:(genops.c:885:class_export_put()) final put ffff8e64c13a6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789023709.257244:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65dddef000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:01000000:0.0:1789023709.260549:0:13089:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789023709.260558:0:13089:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789023709.260562:0:13089:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789023709.260568:0:13089:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789023709.260748:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c13a6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789023709.261194:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65dddeb000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789023709.261408:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789023709.261417:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1789023709.261423:0:13089:0:(genops.c:885:class_export_put()) final put ffff8e65ddded800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1789023709.261426:0:13089:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65ddded800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1789023709.261437:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789023709.261517:0:13089:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65d089d800 1 00000020:00000080:0.0:1789023709.261524:0:13089:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb34179fd 00000020:00000080:0.0:1789023709.261532:0:13089:0:(genops.c:885:class_export_put()) final put ffff8e65d0180000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789023709.261542:0:13089:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789023709.261549:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d0180000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789023709.261559:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023709.261563:0:13089:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789023709.261567:0:13089:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8e65d2724d40) has no exports 00000020:00000080:1.0:1789023709.315288:0:13089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789023709.315303:0:13089:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789023709.315309:0:13089:0:(genops.c:885:class_export_put()) final put ffff8e65d0899800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789023709.315313:0:13089:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d0899800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789023709.315323:0:13089:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789023709.315452:0:13089:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e65d089b800 00000020:02000400:1.0:1789023709.315520:0:13089:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789023709.453728:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023710.474544:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023711.499451:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789023711.651537:0:13244:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789023711.677642:0:13244:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789023711.677718:0:13244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023711.677750:0:13244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023711.677758:0:13244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023711.677765:0:13244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023711.677819:0:13244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789023711.677824:0:13244:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789023711.677845:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789023711.677856:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e65c84c0700 x1875927024878208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023718 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023711.677881:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e65f6c97480 x1875927024878336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023721 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023711.677902:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e65f6c94a80 x1875927024878592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023725 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023711.677916:0:13244:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789023711.677922:0:13244:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789023711.677946:0:13244:0:(import.c:65:import_set_state_nolock()) ffff8e64c2fe1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789023711.678037:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024878336:0@lo:400:kworker.0 00010000:00010000:1.0:1789023711.680072:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023711.680085:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023711.680095:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65d71fca00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023711.680100:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023711.680133:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023711.680144:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023711.680150:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789023711.680153:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789023711.680156:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1789023711.680208:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024878592:0@lo:400:kworker.0 00010000:00010000:1.0:1789023711.680337:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e65c3529000 00010000:00010000:1.0:1789023711.680343:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023711.680349:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fca00/0xc3c1fcbfb3417c18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417c1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023711.680374:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023711.680376:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023711.680377:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023711.680557:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1875927024878208:0@lo:400:kworker.0 00000100:00100000:2.0:1789023711.680583:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875927024878720:0@lo:39:umount.0 00000400:00000100:2.0:1789023711.680623:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875927024878720 offset 0 length 224: 4 00010000:00010000:0.0:1789023712.521956:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023713.547301:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789023714.313710:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789023714.313720:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1789023714.569717:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023715.596364:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023716.619121:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023717.643153:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023718.665928:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789023719.433578:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789023719.433588:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789023719.689789:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023720.718601:0:7644:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023721.738101:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023721.865630:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789023711/real 1789023711] req@ffff8e65f7982300 x1875927024878720/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789023721 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023721.865662:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e65f7982300 x1875927024878720/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789023721 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789023721.865681:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e64c2fe1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789023721.865704:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7982300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875927024878720:0@lo:39:umount.0 00000100:00080000:0.0:1789023721.865855:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789023721.865875:0:13244:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789023721.865889:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789023721.867005:0:13244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867020:0:13244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867028:0:13244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867034:0:13244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867063:0:13244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789023721.867071:0:13244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867077:0:13244:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867083:0:13244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867088:0:13244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023721.867190:0:13244:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789023721.867195:0:13244:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789023721.867216:0:13244:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789023721.867220:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789023721.867234:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789023721.867239:0:13244:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789023721.867244:0:13244:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e65d2788000) has no exports 00000020:00080000:0.0:1789023721.867266:0:13244:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8e65d2788000) has no exports 00000020:01000000:0.0:1789023721.873319:0:13244:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e65ddc7c3c0 - data ffff8e65db45d5e8/ffff8e65e778c400 00000020:01000000:0.0:1789023721.879723:0:13244:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8e65ddc7c0c0 - data ffff8e65f13891b0/ffff8e65fcb8d800 00010000:00010000:1.0:1789023721.881138:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023721.881152:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881163:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c1668e00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023721.881188:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881198:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023721.881205:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023721.881211:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789023721.881214:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1789023721.881216:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1789023721.881233:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e65c3529000 00010000:00010000:1.0:1789023721.881236:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881243:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668e00/0xc3c1fcbfb3417c26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417c2d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881257:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023721.881261:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881266:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713de00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:1.0:1789023721.881269:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881275:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789023721.881281:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023721.881291:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789023721.881293:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789023721.881296:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789023721.881302:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e65c3529000 00010000:00010000:1.0:1789023721.881304:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881310:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3417e6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417e72 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023721.881322:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023721.881324:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023721.881326:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023721.881998:0:7645:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1789023721.895853:0:13244:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789023721.943040:0:13244:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417b1c 00000020:00000080:2.0:1789023721.943048:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e65fc5e8000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789023721.943069:0:13244:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65fc5ee000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789023721.943073:0:13244:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65fc5ee000 2 00000020:01000004:2.0:1789023721.943076:0:13244:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e65fc5ee000 from lustre-OST0001 00000020:00000080:2.0:1789023721.943097:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789023721.943107:0:13244:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789023721.943110:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e65c84a3000/lustre-OST0001_UUID 00000020:00000080:2.0:1789023721.943113:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c84a3000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789023721.943118:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789023721.943213:0:13244:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 72bd38e6-1e7e-4158-85a3-542824dd2807->MGS 00010000:00010000:2.0:1789023721.943230:0:13244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65d71fdc00/0xc3c1fcbfb3417a20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417a27 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023721.943250:0:13244:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65d71fdc00/0xc3c1fcbfb3417a20 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417a27 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023721.943255:0:13244:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789023721.943258:0:13244:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789023721.943261:0:13244:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789023721.943278:0:13244:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e65c3529000 00010000:00010000:2.0:1789023721.943282:0:13244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65d71fdc00/0xc3c1fcbfb3417a20 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417a27 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023721.943296:0:13244:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc3c1fcbfb3417c73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023721.943302:0:13244:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc3c1fcbfb3417c73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023721.943308:0:13244:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789023721.943310:0:13244:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789023721.943312:0:13244:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789023721.943320:0:13244:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e65c3529000 00010000:00010000:2.0:1789023721.943323:0:13244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c1668c00/0xc3c1fcbfb3417c6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc3c1fcbfb3417c73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789023721.943339:0:13244:0:(import.c:65:import_set_state_nolock()) ffff8e65c3529000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789023721.943343:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789023721.943345:0:13244:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789023721.943346:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789023721.943350:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789023721.943360:0:13244:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e65f6c97b80 x1875927024878464/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789023724 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789023721.943385:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789023721.943397:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:2.0:1789023721.943423:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72bd38e6-1e7e-4158-85a3-542824dd2807:3309:1875927024878464:0@lo:250:kworker.0 10000000:01000000:2.0:1789023721.943446:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789023721.943452:0:13244:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb341790f 00000020:00000080:2.0:1789023721.943456:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e65d271d000/72bd38e6-1e7e-4158-85a3-542824dd2807 00000020:01000000:2.0:1789023721.943461:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.148@tcp (flags='') 00000020:00000080:2.0:1789023721.943465:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789023721.943513:0:13244:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789023721.943517:0:13244:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8e65d2720000) has no exports 00000020:00000080:3.0:1789023721.943733:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65fc5e8000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789023721.943747:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d271d000/72bd38e6-1e7e-4158-85a3-542824dd2807 for MGC192.168.203.148@tcp 10000000:01000000:1.0:1789023721.944072:0:5843:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789023721.944162:0:13244:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.148@tcp: client import never connected 00000100:00080000:3.0:1789023721.944165:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789023721.944168:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789023721.944170:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789023721.944172:0:13244:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789023721.944213:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789023721.944218:0:13244:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.148@tcp (uuid 72bd38e6-1e7e-4158-85a3-542824dd2807) 00000020:01000000:3.0:1789023721.944224:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789023721.944228:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789023721.944231:0:13244:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789023721.944237:0:13244:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e64c2fe1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789023721.944242:0:13244:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8e65d27899c0) has exports, disconnecting them 00000020:00080000:3.0:1789023721.944246:0:13244:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e64c2fe1000), last request at 1789023524 00000020:00000080:3.0:1789023721.944250:0:13244:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417b46 00000020:00080000:3.0:1789023721.944261:0:13244:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e64c2fe1000): rc 0 00000020:00000080:3.0:1789023721.944265:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e64c2fe1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789023721.945520:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e65c3529000 for MGC192.168.203.148@tcp 00000020:00000080:1.0:1789023721.945530:0:8:0:(genops.c:885:class_export_put()) final put ffff8e65c352f800/72bd38e6-1e7e-4158-85a3-542824dd2807 00000020:00000080:1.0:1789023721.945533:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65c352f800/72bd38e6-1e7e-4158-85a3-542824dd2807 for MGC192.168.203.148@tcp 00000020:01000000:1.0:1789023721.945547:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.148@tcp (72bd38e6-1e7e-4158-85a3-542824dd2807) 00000020:00000080:1.0:1789023721.946014:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c2fe1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789023721.946160:0:13244:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789023721.946164:0:13244:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789023721.946167:0:13244:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789023721.946172:0:13244:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789023721.946409:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8e64c2fe1800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1789023721.947766:0:7644:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789023721.948110:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789023721.948237:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789023721.948803:0:7645:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:2.0:1789023721.949002:0:5829:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e65c8d17000:5829] 1 exiting: rc = 0 00000100:00100000:1.0:1789023721.949995:0:7643:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8e65f6b8b400:7643] 2 exiting: rc = 0 00000100:00100000:1.0:1789023721.950062:0:5828:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e65c397be00:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1789023721.950224:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.950535:0:5830:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e65ee840200:5830] 0 exiting: rc = 1 00000100:00100000:1.0:1789023721.950975:0:5831:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e65ee840c00:5831] 1 exiting: rc = 0 00000100:00100000:1.0:1789023721.951031:0:6710:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e64c117ba00:6710] 3 exiting: rc = 0 00000100:00100000:0.0:1789023721.954046:0:5832:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e65c355c000:5832] 2 exiting: rc = 0 00000100:00100000:2.0:1789023721.954226:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954234:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954241:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954247:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954253:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954258:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954265:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954270:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954275:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954281:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954286:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954292:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954297:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954303:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954327:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954335:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954341:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954346:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954351:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954356:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954361:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954367:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954371:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954376:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954380:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954385:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954398:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954404:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954409:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954413:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954417:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954421:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954426:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954430:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954434:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954439:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954444:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954449:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954453:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954458:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954462:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954469:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954473:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954497:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954502:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954516:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954521:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954526:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954531:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954556:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954562:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954571:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954584:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954589:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954594:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954599:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954604:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954608:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954613:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954619:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954624:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954633:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954640:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.954645:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789023721.956403:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789023721.956415:0:13244:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789023721.956421:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e64c2fe7000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789023721.956426:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c2fe7000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789023721.956431:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789023721.956466:0:13244:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65fc5ee000 1 00000020:00000080:2.0:1789023721.956472:0:13244:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc3c1fcbfb3417aeb 00000020:00000080:2.0:1789023721.956513:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e64c13a2800/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789023721.956520:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789023721.956524:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789023721.956529:0:13244:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789023721.956532:0:13244:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8e65c85a19c0) has no exports 00000020:00000080:1.0:1789023721.957035:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8e64c13a2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789023721.974369:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789023721.974383:0:13244:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789023721.974398:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e65fc5ef800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789023721.974402:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65fc5ef800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789023721.974409:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1789023721.974781:0:13244:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8e65fc5ed000 00000020:01000000:2.0:1789023721.974812:0:13244:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1789023721.974816:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789023721.974820:0:13244:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789023721.974824:0:13244:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8e65d278b380) has no exports 00000020:00000080:2.0:1789023721.974847:0:13244:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789023721.974853:0:13244:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1789023721.974856:0:13244:0:(genops.c:885:class_export_put()) final put ffff8e65d0185000/OSS_uuid 00000020:00000080:2.0:1789023721.974858:0:13244:0:(genops.c:844:class_export_destroy()) destroying export ffff8e65d0185000/OSS_uuid for OSS 00000020:01000000:2.0:1789023721.974864:0:13244:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1789023721.974891:0:5841:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789023721.976752:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8e65ddc04800:6696] 2 exiting: rc = 0 00000100:00100000:2.0:1789023721.980786:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8e65d2921800:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1789023721.980882:0:12456:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8e65e77bca00:12456] 4 exiting: rc = 0 00000100:00100000:2.0:1789023721.980937:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8e65d2921a00:6695] 1 exiting: rc = 0 00000100:00100000:0.0:1789023721.982078:0:7164:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8e64c117ae00:7164] 3 exiting: rc = 0 00000100:00100000:2.0:1789023721.988796:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988806:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988822:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988830:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988835:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988840:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988845:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988850:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988855:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988861:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988866:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988870:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988876:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988880:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988885:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.988889:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989158:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989163:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989168:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989173:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989196:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989202:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989207:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989211:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989216:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989221:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989227:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989232:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989238:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989243:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989248:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989253:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989258:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989263:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989268:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989274:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989301:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989307:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989311:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989316:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989320:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989326:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989331:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989335:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989352:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989358:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989363:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989367:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989371:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989376:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989380:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989384:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989398:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989404:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989408:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989418:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989423:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989427:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989431:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989436:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989440:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989444:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989448:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.989458:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789023721.997143:0:8113:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8e65ffc90800:8113] 2 exiting: rc = 0 00000100:00100000:0.0:1789023722.004841:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e65de1c6200:6697] 0 exiting: rc = 1 00000100:00100000:0.0:1789023722.005402:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e65de1c7800:6698] 1 exiting: rc = 0 00000100:00100000:1.0:1789023722.006691:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006709:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006714:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006719:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006723:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006728:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006733:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006737:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006741:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006745:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006750:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006754:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006759:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006763:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006767:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006771:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006775:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006780:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006784:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006789:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006793:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006798:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006802:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006807:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006811:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006816:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006820:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006825:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006829:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006833:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006837:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006841:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006845:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006850:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006865:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006870:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006875:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006879:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006884:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006891:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006896:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006901:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006907:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006912:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006917:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006921:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006926:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006930:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006934:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006939:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006943:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006948:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006952:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006956:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006960:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.006964:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007878:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007886:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007891:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007896:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007901:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007905:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007909:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.007914:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.008674:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e65de1c7e00:6700] 1 exiting: rc = 0 00000100:00100000:3.0:1789023722.008689:0:6701:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e65f6be7400:6701] 2 exiting: rc = 0 00000100:00100000:0.0:1789023722.009095:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e65de1c6a00:6699] 0 exiting: rc = 1 00000100:00100000:1.0:1789023722.009244:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009252:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009259:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009265:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009283:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009293:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009300:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009306:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009310:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009316:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009323:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009328:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009333:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009338:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009343:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009348:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009354:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009359:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009364:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009381:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009403:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009409:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009414:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009419:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009424:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009428:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009433:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009439:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009444:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009448:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009453:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009458:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009463:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009468:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009473:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009503:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009511:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009517:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009522:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009534:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009540:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009545:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009550:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009555:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009560:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009570:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009576:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009581:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009586:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009608:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009618:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009624:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009628:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009633:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009638:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009644:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009648:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009654:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009659:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009667:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009673:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009678:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009685:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.009693:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789023722.013565:0:6702:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e65f6be6800:6702] 0 exiting: rc = 1 00000100:00100000:3.0:1789023722.013641:0:6703:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e65f6be6a00:6703] 1 exiting: rc = 0 00000100:00100000:1.0:1789023722.013909:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013917:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013922:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013929:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013936:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013943:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013949:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013953:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013956:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013960:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013969:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013972:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013976:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013979:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.013997:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014001:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014005:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014008:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014011:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014015:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014018:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014021:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014024:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014027:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014030:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014032:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014035:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014038:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014042:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014048:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014054:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014057:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014066:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014072:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014077:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014082:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014089:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014097:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014105:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014110:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014117:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014128:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014137:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014144:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014152:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014165:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014171:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014177:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014189:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014196:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014203:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014211:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014221:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014226:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014231:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014236:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014241:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014245:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014250:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014256:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014262:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014271:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014279:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.014284:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789023722.015116:0:6704:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e65fc578e00:6704] 0 exiting: rc = 1 00000100:00100000:2.0:1789023722.015121:0:6705:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e65fc578600:6705] 1 exiting: rc = 0 00000100:00100000:1.0:1789023722.015168:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015177:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015186:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015193:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015199:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015217:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015225:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015232:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015242:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015264:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015271:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015277:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015282:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015288:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015293:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015298:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015313:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015319:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015324:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015330:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015336:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015356:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015366:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015373:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015380:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015400:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015412:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015419:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015425:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015431:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015437:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015445:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015453:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015506:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015514:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015520:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015526:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015532:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015539:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015545:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015550:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015556:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015562:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015567:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015573:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015594:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015600:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015606:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015612:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015618:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015629:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015642:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015648:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015653:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015659:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015665:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015671:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015685:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015690:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015694:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015698:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015702:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015706:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789023722.015713:0:13244:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1789023722.021523:0:13244:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789023738.465710:0:13861:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789023748.653736:0:14322:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789023748.653741:0:14322:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789023748.653853:0:14322:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e65e74a3000 00000020:01000004:3.0:1789023748.653867:0:14322:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789023748.653875:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789023748.653887:0:14322:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e65c85a0000) 00000020:00000080:3.0:1789023748.653898:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789023748.698592:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789023748.707960:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1789023748.708660:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 217: rc = 0 00100000:10000000:1.0:1789023748.708752:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 217: rc = 0 00100000:10000000:1.0:1789023748.709738:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789023748.709891:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 217: rc = 0 00100000:10000000:1.0:1789023748.710076:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 217: rc = 0 00100000:10000000:1.0:1789023748.710366:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 217: rc = 0 00100000:10000000:1.0:1789023748.710464:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 217: rc = 0 00100000:10000000:1.0:1789023748.710732:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 219: rc = 0 00100000:10000000:1.0:1789023748.712607:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 16: rc = 0 00100000:10000000:1.0:1789023748.712698:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 16: rc = 0 00100000:10000000:1.0:1789023748.713593:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 613: rc = 0 00100000:10000000:1.0:1789023748.714436:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 613: rc = 0 00100000:10000000:1.0:1789023748.714728:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 613: rc = 0 00100000:10000000:1.0:1789023748.715373:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 613: rc = 0 00100000:10000000:1.0:1789023748.715710:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 613: rc = 0 00100000:10000000:1.0:1789023748.716905:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 613: rc = 0 00100000:10000000:1.0:1789023748.719513:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 613: rc = 0 00100000:10000000:1.0:1789023748.719803:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 613: rc = 0 00100000:10000000:1.0:1789023748.720060:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 613: rc = 0 00100000:10000000:1.0:1789023748.721587:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 613: rc = 0 00100000:10000000:1.0:1789023748.721881:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 613: rc = 0 00100000:10000000:1.0:1789023748.726566:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 613: rc = 0 00100000:10000000:1.0:1789023748.727039:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 27: rc = 0 00100000:10000000:1.0:1789023748.728942:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 27: rc = 0 00100000:10000000:1.0:1789023748.729622:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 27: rc = 0 00100000:10000000:1.0:1789023748.731352:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 27: rc = 0 00100000:10000000:1.0:1789023748.731621:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 27: rc = 0 00100000:10000000:1.0:1789023748.731860:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 27: rc = 0 00100000:10000000:2.0:1789023748.734344:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 27: rc = 0 00100000:10000000:2.0:1789023748.734692:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 27: rc = 0 00100000:10000000:2.0:1789023748.736640:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 27: rc = 0 00100000:10000000:2.0:1789023748.736913:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 27: rc = 0 00100000:10000000:2.0:1789023748.738027:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 27: rc = 0 00100000:10000000:2.0:1789023748.739123:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 27: rc = 0 00100000:10000000:2.0:1789023748.739433:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 27: rc = 0 00100000:10000000:2.0:1789023748.739910:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 27: rc = 0 00100000:10000000:2.0:1789023748.740472:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 27: rc = 0 00100000:10000000:2.0:1789023748.740748:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 27: rc = 0 00100000:10000000:2.0:1789023748.742955:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 27: rc = 0 00100000:10000000:3.0:1789023748.750952:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 27: rc = 0 00100000:10000000:3.0:1789023748.752587:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 27: rc = 0 00100000:10000000:3.0:1789023748.752856:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 27: rc = 0 00100000:10000000:3.0:1789023748.753124:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 27: rc = 0 00100000:10000000:3.0:1789023748.753395:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 27: rc = 0 00100000:10000000:3.0:1789023748.753659:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 27: rc = 0 00100000:10000000:3.0:1789023748.753882:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 27: rc = 0 00100000:10000000:3.0:1789023748.754123:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 27: rc = 0 00100000:10000000:3.0:1789023748.754411:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 27: rc = 0 00100000:10000000:3.0:1789023748.754699:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 27: rc = 0 00100000:10000000:3.0:1789023748.754927:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 27: rc = 0 00100000:10000000:3.0:1789023748.767765:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 27: rc = 0 00100000:10000000:3.0:1789023748.768062:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 27: rc = 0 00100000:10000000:3.0:1789023748.768351:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 27: rc = 0 00100000:10000000:3.0:1789023748.768624:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 27: rc = 0 00100000:10000000:3.0:1789023748.768977:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 20: rc = 0 00100000:10000000:3.0:1789023748.769457:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1789023748.769646:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 491: rc = 0 00100000:10000000:3.0:1789023748.769819:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1789023748.769879:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 491: rc = 0 00100000:10000000:3.0:1789023748.770062:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1789023748.770123:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 491: rc = 0 00100000:10000000:2.0:1789023748.779589:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789023748.779693:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 17: rc = 0 00100000:10000000:2.0:1789023748.781386:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789023748.781495:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 17: rc = 0 00100000:10000000:2.0:1789023748.781709:0:14322:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789023748.782921:0:14322:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 17: rc = 0 00000020:00000080:2.0:1789023748.784277:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789023748.784293:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789023748.784303:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3418c02 00000020:01000004:2.0:1789023748.784312:0:14322:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789023748.784318:0:14322:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789023748.784323:0:14322:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e65e74a3000 from MGS 00000020:01000004:2.0:1789023748.784327:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789023748.784338:0:14322:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e65d27899c0) 00000020:00000080:2.0:1789023748.784348:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789023748.784399:0:14322:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65e74a3000 from MGS, refs=2 00080000:01000000:2.0:1789023748.784403:0:14322:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789023748.784407:0:14322:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3418c10 00000100:00100000:2.0:1789023748.784880:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789023748.785062:0:14322:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789023748.785068:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789023748.786719:0:14322:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789023748.786733:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789023748.787327:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023748.787528:0:14322:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789023748.787533:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789023748.788506:0:14322:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789023748.788515:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789023748.788920:0:14322:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789023748.788927:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789023748.789700:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023748.789703:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023748.789704:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023748.790026:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023748.790029:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023748.790031:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023748.790960:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789023748.803509:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1789023748.808915:0:14322:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789023748.808931:0:14322:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789023748.808934:0:14322:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789023748.810865:0:14331:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789023748.811143:0:14322:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789023748.811330:0:14322:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789023748.811782:0:14322:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789023748.812452:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789023748.812853:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789023748.812860:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789023748.813625:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789023748.813632:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789023748.814151:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789023748.814158:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789023748.825848:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789023748.825872:0:14322:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.148@tcp' 00000020:01000004:0.0:1789023748.825874:0:14322:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789023748.825901:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.148@tcp (typ=mgc) 00000020:00000080:0.0:1789023748.825912:0:14322:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.148@tcp (ffff8e65f00419c0) 00000020:00000080:0.0:1789023748.825929:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789023748.826010:0:14322:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65c35a5800@MGC192.168.203.148@tcp: add connection 192.168.203.148@tcp at head 00000100:00080000:3.0:1789023748.827123:0:14336:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1789023748.829107:0:14322:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.148@tcp-0 is initialized 00000040:01000000:1.0:1789023748.829118:0:14322:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789023748.831415:0:14337:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789023748.831525:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.148@tcp (uuid 96e4333f-cc82-4def-9373-4ed84d9f7775) 00000020:00000080:3.0:1789023748.831548:0:14322:0:(genops.c:1384:class_connect()) connect: client 96e4333f-cc82-4def-9373-4ed84d9f7775, cookie 0xc3c1fcbfb3418c1e 00000100:00080000:3.0:1789023748.831559:0:14322:0:(import.c:545:import_select_connection()) MGC192.168.203.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023748.831570:0:14322:0:(import.c:666:import_select_connection()) MGC192.168.203.148@tcp: import ffff8e65c35a5800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789023748.831601:0:14322:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65c84c3b80 x1875927024878848/t0(0) o250->MGC192.168.203.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023748.831628:0:14322:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 96e4333f-cc82-4def-9373-4ed84d9f7775->MGS 00000020:01000004:3.0:1789023748.831648:0:14322:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789023748.831653:0:14322:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789023748.831665:0:14322:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e65c85a4d40) 00000020:00000080:3.0:1789023748.831675:0:14322:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789023748.831818:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:96e4333f-cc82-4def-9373-4ed84d9f7775:3309:1875927024878848:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789023748.831877:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023748.833536:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024878848 00000100:00100000:0.0:1789023748.833553:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024878848 00000100:00100000:0.0:1789023748.833588:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023748.833596:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1875927024878848:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789023748.833621:0:14332:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 96e4333f-cc82-4def-9373-4ed84d9f7775@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:0.0:1789023748.833643:0:14332:0:(genops.c:1384:class_connect()) connect: client 96e4333f-cc82-4def-9373-4ed84d9f7775, cookie 0xc3c1fcbfb3418c2c 00000100:00080000:0.0:1789023748.833755:0:14332:0:(import.c:65:import_set_state_nolock()) ffff8e65c35a3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023748.833818:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+5:3309:x1875927024878848:12345-0@lo:250:mount.lustre.0 Request processed in 221us (1940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023748.833825:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023748.833860:0:3309:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789023748.833868:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1789023748.833875:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789023748.833884:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789023748.833887:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65c35a5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789023748.833889:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789023748.833896:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789023748.833901:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:96e4333f-cc82-4def-9373-4ed84d9f7775:3309:1875927024878848:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789023748.847904:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789023748.848094:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789023748.848101:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789023748.860392:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789023748.860404:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789023748.863516:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789023748.863530:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789023748.864768:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023748.864989:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789023748.864995:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789023748.866568:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789023748.866578:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789023748.951224:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023748.953863:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789023748.953872:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789023748.960243:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789023748.960258:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789023748.961202:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023748.961379:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789023748.961391:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789023748.962453:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789023748.962470:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789023748.963174:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023748.963351:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789023748.963356:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789023748.964061:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789023748.964074:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789023748.964656:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789023748.964807:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789023748.964812:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789023748.965368:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789023748.965376:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789023749.011034:0:14322:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789023749.012013:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789023749.012020:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789023749.024446:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789023749.024469:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789023749.028336:0:14322:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789023749.028350:0:14322:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789023749.030507:0:14322:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789023749.030533:0:14322:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789023749.030538:0:14322:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789023749.030670:0:14322:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789023749.030706:0:14322:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789023749.030711:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789023749.030712:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789023749.030714:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023749.030715:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023749.030716:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023749.030717:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023749.030718:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789023749.030719:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789023749.030721:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023749.030722:0:14322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789023749.030725:0:14322:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789023749.030726:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789023749.030728:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789023749.030729:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023749.030730:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023749.030731:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023749.030732:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023749.030733:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789023749.030733:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789023749.030734:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023749.030735:0:14322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789023749.030759:0:14322:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789023749.030789:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024878976:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789023749.030866:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.030913:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023749.031365:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024878976 00000100:00100000:2.0:1789023749.031375:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024878976 00000100:00100000:2.0:1789023749.031413:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023749.031421:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+5:14322:x1875927024878976:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789023749.031857:0:14334:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789023749.031861:0:14334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789023749.031864:0:14334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789023749.036796:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789023749.044417:0:14334:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1789023749.049359:0:14357:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1789023749.049368:0:14357:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1789023749.049370:0:14357:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1789023749.049406:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1789023749.050627:0:14334:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789023749.050639:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789023749.088914:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+5:14322:x1875927024878976:12345-0@lo:253:mount.lustre.0 Request processed in 57484us (58038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.088932:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023749.092432:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024878976:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789023749.092859:0:14322:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789023749.092863:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023749.092864:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789023749.092866:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023749.092867:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023749.092868:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023749.092869:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023749.092870:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789023749.092872:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789023749.092873:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023749.092874:0:14322:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789023749.092964:0:14322:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e65e74a3000 from lustre-MDT0000 10000000:01000000:1.0:1789023749.092995:0:14322:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789023749.093009:0:14322:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789023749.093013:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e65f00419c0 10000000:01000000:1.0:1789023749.093016:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789023749.093024:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8e65f00419c0 from 1 10000000:01000000:1.0:1789023749.093027:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789023749.093065:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.093296:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.093306:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023749.093328:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789023749.093391:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023749.093530:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023749.094359:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024879104 00000100:00100000:3.0:1789023749.094367:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024879104 00000100:00100000:3.0:1789023749.094418:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789023749.094428:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+5:14322:x1875927024879104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789023749.094746:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023749.094765:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713c800/0xc3c1fcbfb3418c3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418c33 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.094791:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713c800/0xc3c1fcbfb3418c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418c33 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.094802:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713c800/0xc3c1fcbfb3418c3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418c33 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.094810:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c800, rc 0) 00000100:00100000:3.0:1789023749.094870:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+6:14322:x1875927024879104:12345-0@lo:101:mount.lustre.0 Request processed in 443us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023749.094876:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023749.095042:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023749.095060:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.095069:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023749.095279:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023749.095311:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023749.095402:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023749.096628:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024879232 00000100:00100000:2.0:1789023749.096638:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024879232 00000100:00100000:3.0:1789023749.096806:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789023749.096816:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+6:14322:x1875927024879232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789023749.097120:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+6:14322:x1875927024879232:12345-0@lo:501:mount.lustre.0 Request processed in 305us (1806us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789023749.097127:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023749.097377:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879232:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789023749.097413:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789023749.097433:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.097451:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023749.097466:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e65e74a3000 10000000:01000000:2.0:1789023749.097471:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789023749.097645:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e65e74a3000 10000000:01000000:2.0:1789023749.097649:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789023749.097653:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8e65e74a3000 from 1 10000000:01000000:2.0:1789023749.097655:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789023749.097695:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06c00/0xc3c1fcbfb3418c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.097704:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06c00/0xc3c1fcbfb3418c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.097713:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06c00/0xc3c1fcbfb3418c41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023749.097729:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879360:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789023749.097759:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023749.097782:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.097836:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024879360 00000100:00100000:0.0:1789023749.097841:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024879360 00000100:00100000:0.0:1789023749.097873:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789023749.097880:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+6:14322:x1875927024879360:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789023749.097890:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023749.097902:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05600/0xc3c1fcbfb3418c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418c41 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.097921:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05600/0xc3c1fcbfb3418c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418c41 expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.097931:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d05600/0xc3c1fcbfb3418c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418c41 expref: 7 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.097940:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05600, rc 0) 00000100:00100000:0.0:1789023749.097974:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+7:14322:x1875927024879360:12345-0@lo:101:mount.lustre.0 Request processed in 94us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.097989:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789023749.098260:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879360:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789023749.098272:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06c00/0xc3c1fcbfb3418c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c48 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.098281:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06c00/0xc3c1fcbfb3418c41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418c48 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023749.098294:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789023749.098308:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06c00/0xc3c1fcbfb3418c41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c48 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.098315:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06c00/0xc3c1fcbfb3418c41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c48 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023749.098321:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789023749.098324:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789023749.098328:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e65e74a3000 10000000:01000000:2.0:1789023749.098335:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789023749.098339:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789023749.098341:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789023749.098357:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06e00/0xc3c1fcbfb3418c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.098363:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06e00/0xc3c1fcbfb3418c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.098370:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06e00/0xc3c1fcbfb3418c4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023749.098382:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789023749.098404:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023749.098420:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.098608:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024879488 00000100:00100000:0.0:1789023749.098612:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024879488 00000100:00100000:0.0:1789023749.098639:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789023749.098645:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+7:14322:x1875927024879488:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789023749.098652:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023749.098659:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04c00/0xc3c1fcbfb3418c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418c4f expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.098672:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04c00/0xc3c1fcbfb3418c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418c4f expref: 8 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.098680:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04c00/0xc3c1fcbfb3418c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418c4f expref: 8 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.098687:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04c00, rc 0) 00000100:00100000:0.0:1789023749.098717:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+8:14322:x1875927024879488:12345-0@lo:101:mount.lustre.0 Request processed in 72us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.098722:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023749.098865:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879488:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789023749.098874:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06e00/0xc3c1fcbfb3418c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c56 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.098882:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06e00/0xc3c1fcbfb3418c4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418c56 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023749.098922:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789023749.098944:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023749.098970:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.099015:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024879616 00000100:00100000:0.0:1789023749.099019:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024879616 00000100:00100000:0.0:1789023749.099091:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789023749.099098:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+8:14322:x1875927024879616:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023749.099466:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14322:x1875927024879616:12345-0@lo:501:mount.lustre.0 Request processed in 368us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.099473:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789023749.099762:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879616:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789023749.099793:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789023749.099833:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023749.099866:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023749.101704:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024879744 00000100:00100000:3.0:1789023749.101715:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024879744 00000100:00100000:3.0:1789023749.101757:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023749.101765:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14322:x1875927024879744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789023749.102307:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14322:x1875927024879744:12345-0@lo:503:mount.lustre.0 Request processed in 541us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023749.102314:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789023749.102679:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024879744:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789023749.103646:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14358:1875927024879872:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789023749.103706:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023749.103783:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc72480 going to sleep for 11 seconds 00000100:00100000:3.0:1789023749.103897:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024879872 00000100:00100000:3.0:1789023749.103909:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024879872 00000100:00100000:3.0:1789023749.103948:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789023749.103956:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14358:x1875927024879872:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023749.104720:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14358:x1875927024879872:12345-0@lo:502:llog_process_th.0 Request processed in 761us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023749.104728:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023749.104820:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14358:1875927024879872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023749.104854:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023749.104864:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.104866:0:14358:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789023749.104873:0:14358:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789023749.104876:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023749.104889:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e65f0040000) 00000020:00000080:0.0:1789023749.104905:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789023749.104910:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789023749.104978:0:14358:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789023749.104985:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3418c64 00000020:00000080:0.0:1789023749.105432:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789023749.105437:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023749.105441:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.105442:0:14358:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789023749.105445:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023749.105448:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.105450:0:14358:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789023749.105454:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789023749.105463:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e65f0043380) 00000020:00000080:0.0:1789023749.105474:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789023749.105520:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789023749.105522:0:14358:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789023749.105525:0:14358:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789023749.105531:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789023749.105583:0:14358:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65e74a3000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789023749.105597:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e65f0044d40) 00000020:00000080:0.0:1789023749.105609:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789023749.105647:0:14358:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789023749.105651:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3418c79 00000020:00000080:0.0:1789023749.105739:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789023749.105744:0:14358:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789023749.105749:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc3c1fcbfb3418c80 00080000:01000000:0.0:1789023749.105759:0:14358:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789023749.105763:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3418c87 00010000:00010000:2.0:1789023749.198856:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789023749.200057:0:14358:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789023749.200374:0:14358:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789023749.201297:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e65d2788000) 00000020:00000080:2.0:1789023749.201317:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789023749.201386:0:14358:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789023749.201392:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3418c95 00000020:00000080:3.0:1789023749.202523:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789023749.205408:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc3c1fcbfb3418c9c 00000020:00000080:3.0:1789023749.210951:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789023749.210964:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023749.210971:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.210974:0:14358:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789023749.210988:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789023749.210992:0:14358:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1789023749.210993:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789023749.210995:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789023749.210997:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789023749.211000:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.211002:0:14358:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789023749.211005:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023749.211010:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.211011:0:14358:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789023749.211016:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789023749.211057:0:14358:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789023749.211092:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023749.211096:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.211097:0:14358:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789023749.211100:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789023749.211103:0:14358:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789023749.211106:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.211108:0:14358:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789023749.211119:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789023749.211124:0:14358:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:3.0:1789023749.212070:0:14358:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789023749.212083:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789023749.212099:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e65c85a3380) 00000020:00000080:3.0:1789023749.212118:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789023749.212124:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789023749.212350:0:14358:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789023749.212356:0:14358:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789023749.212363:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3418caa 00010000:00080000:3.0:1789023749.212393:0:14358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65f78e7000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789023749.212712:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1789023749.213770:0:14358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789023749.213825:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789023749.217358:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023749.219370:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1789023749.220424:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789023749.220975:0:14362:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789023749.220980:0:14362:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789023749.222048:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789023749.222060:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789023749.222690:0:14358:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789023749.222713:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3418cb1 00000100:00080000:3.0:1789023749.222723:0:14358:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023749.222735:0:14358:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e65f78e7000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789023749.222774:0:14358:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65c84c2a00 x1875927024880000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789023749.223022:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024880000:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789023749.223072:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927024880000 offset 0 length 520: 4 00000100:00080000:3.0:1789023749.224439:0:14358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789023749.224540:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023749.224546:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.224554:0:14358:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789023749.224558:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789023749.224561:0:14358:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789023749.224562:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789023749.224564:0:14358:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789023749.224565:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789023749.224567:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.224569:0:14358:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789023749.224571:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789023749.224576:0:14358:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789023749.224578:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.224580:0:14358:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789023749.224583:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789023749.224586:0:14358:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.148@tcp to nid 0x20000c0a8cb94 (192.168.203.148@tcp) 00000020:01000000:3.0:1789023749.224607:0:14358:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789023749.224610:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789023749.224626:0:14358:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e65c85a19c0) 00000020:00000080:3.0:1789023749.224645:0:14358:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1789023749.224651:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789023749.224712:0:14358:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789023749.224719:0:14358:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789023749.224727:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc3c1fcbfb3418cbf 00010000:00080000:3.0:1789023749.224755:0:14358:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65e64e8000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:3.0:1789023749.224992:0:14358:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1789023749.225819:0:14358:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789023749.225841:0:14358:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789023749.232059:0:14358:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023749.232199:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789023749.232306:0:14358:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1789023749.233084:0:14364:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789023749.233089:0:14364:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789023749.234191:0:14358:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789023749.234203:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789023749.234244:0:14358:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789023749.234268:0:14358:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3418cc6 00000100:00080000:3.0:1789023749.234282:0:14358:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789023749.234293:0:14358:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e65e64e8000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:3.0:1789023749.234338:0:14358:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65c84c0e00 x1875927024880128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789023749.234366:0:14358:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789023749.234448:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024880128:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789023749.234542:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927024880128 offset 0 length 520: 4 00000020:01000000:3.0:1789023749.234925:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023749.234930:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.234932:0:14358:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789023749.234935:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023749.234939:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.234941:0:14358:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789023749.234943:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789023749.234945:0:14358:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789023749.234947:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023749.234949:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.234951:0:14358:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789023749.234953:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789023749.234956:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.234957:0:14358:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789023749.234961:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789023749.234989:0:14358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14358:1875927024880256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789023749.235063:0:14358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023749.235099:0:14358:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.235610:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024880256 00000100:00100000:1.0:1789023749.235618:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024880256 00000100:00100000:1.0:1789023749.235657:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023749.235666:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14358:x1875927024880256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023749.235926:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14358:x1875927024880256:12345-0@lo:502:llog_process_th.0 Request processed in 260us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.235933:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789023749.236039:0:14358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14358:1875927024880256:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789023749.236066:0:14358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789023749.236087:0:14358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789023749.236089:0:14358:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789023749.236093:0:14358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789023749.236348:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789023749.236370:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789023749.236391:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06e00/0xc3c1fcbfb3418c4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c56 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.236402:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06e00/0xc3c1fcbfb3418c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c56 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023749.236411:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65e74a3000 from 1 10000000:01000000:1.0:1789023749.236413:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789023749.236450:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.236465:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.236492:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023749.236517:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880384:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789023749.236549:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023749.236572:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208540 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.236591:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024880384 00000100:00100000:1.0:1789023749.236595:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024880384 00000100:00100000:1.0:1789023749.236617:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023749.236624:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+9:14322:x1875927024880384:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023749.236632:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023749.236647:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418ccd expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.236668:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 10 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.236678:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 10 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.236686:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707e200, rc 0) 00000100:00100000:1.0:1789023749.236714:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+10:14322:x1875927024880384:12345-0@lo:101:mount.lustre.0 Request processed in 91us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.236720:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023749.236752:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023749.236763:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.236772:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023749.237784:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880512:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789023749.237827:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023749.237846:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023749.238052:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024880512 00000100:00100000:3.0:1789023749.238059:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024880512 00000100:00100000:3.0:1789023749.238119:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789023749.238127:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+10:14322:x1875927024880512:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789023749.238294:0:14334:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789023749.238301:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789023749.238372:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+10:14322:x1875927024880512:12345-0@lo:256:mount.lustre.0 Request processed in 245us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023749.238378:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023749.238469:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880512:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789023749.240338:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789023749.240418:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.240431:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023749.240449:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65e74a3000 from 1 10000000:01000000:1.0:1789023749.240451:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789023749.240517:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.240526:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.240536:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023749.240561:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880640:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789023749.240615:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023749.240649:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208540 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.240676:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024880640 00000100:00100000:1.0:1789023749.240683:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024880640 00000100:00100000:1.0:1789023749.240734:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023749.240742:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+10:14322:x1875927024880640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023749.240754:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023749.240765:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418cdb expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.240787:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 11 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.240798:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 11 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.240806:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fa00, rc 0) 00000100:00100000:1.0:1789023749.240839:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14322:x1875927024880640:12345-0@lo:101:mount.lustre.0 Request processed in 98us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.240846:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023749.240891:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880640:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023749.240902:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.240911:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023749.240957:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880768:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023749.240981:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023749.240994:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208540 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.241008:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024880768 00000100:00100000:1.0:1789023749.241011:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024880768 00000100:00100000:1.0:1789023749.241038:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789023749.241044:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14322:x1875927024880768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023749.243430:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14322:x1875927024880768:12345-0@lo:501:mount.lustre.0 Request processed in 2380us (2442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.243450:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789023749.244839:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023749.244897:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023749.244958:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.244991:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1789023749.245045:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024880896 00000100:00100000:2.0:1789023749.245052:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024880896 00000100:00100000:2.0:1789023749.245112:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789023749.245121:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14322:x1875927024880896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789023749.245305:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14322:x1875927024880896:12345-0@lo:503:mount.lustre.0 Request processed in 185us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023749.245312:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023749.245672:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024880896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023749.246528:0:14366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14366:1875927024881024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023749.246577:0:14366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.246599:0:14366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.246747:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881024 00000100:00100000:1.0:1789023749.246753:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881024 00000100:00100000:1.0:1789023749.246784:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789023749.246792:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14366:x1875927024881024:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023749.246989:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14366:x1875927024881024:12345-0@lo:502:llog_process_th.0 Request processed in 198us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.246996:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789023749.247267:0:14366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14366:1875927024881024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023749.247292:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023749.247302:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.247304:0:14366:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789023749.247312:0:14366:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65e74a3000 00000020:00000080:0.0:1789023749.247315:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789023749.247322:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023749.247325:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.247326:0:14366:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789023749.247329:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023749.247331:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.247332:0:14366:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789023749.247335:0:14366:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65e74a3000 00000020:00000080:0.0:1789023749.247336:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789023749.247389:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023749.247392:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.247393:0:14366:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789023749.247396:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789023749.247398:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.247404:0:14366:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789023749.247408:0:14366:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e65e74a3000 00000020:00000080:0.0:1789023749.247410:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789023749.249351:0:14366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14366:1875927024881152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023749.249459:0:14366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.250258:0:14366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8480 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.265657:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881152 00000100:00100000:1.0:1789023749.265671:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881152 00000100:00100000:1.0:1789023749.267396:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789023749.267413:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14366:x1875927024881152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789023749.267722:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14366:x1875927024881152:12345-0@lo:502:llog_process_th.0 Request processed in 315us (18268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.267730:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789023749.276061:0:14366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14366:1875927024881152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789023749.276143:0:14366:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789023749.276154:0:14366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789023749.276156:0:14366:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789023749.276160:0:14366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789023749.276711:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789023749.276737:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023749.276753:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.276765:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023749.276810:0:14322:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789023749.276814:0:14322:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e65e74a3000 10000000:01000000:0.0:1789023749.276817:0:14322:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e65e74a3000 10000000:01000000:0.0:1789023749.276821:0:14322:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789023749.276827:0:14322:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65e74a3000 from 1 10000000:01000000:0.0:1789023749.276830:0:14322:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789023749.276866:0:14322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04000/0xc3c1fcbfb3418ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.276882:0:14322:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04000/0xc3c1fcbfb3418ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.276909:0:14322:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04000/0xc3c1fcbfb3418ce9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023749.276930:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024881280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789023749.276992:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.277033:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.277117:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881280 00000100:00100000:1.0:1789023749.277124:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881280 00000100:00100000:1.0:1789023749.277176:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789023749.277186:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14322:x1875927024881280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023749.277198:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023749.277219:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e707fe00/0xc3c1fcbfb3418cf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418ce9 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.277254:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707fe00/0xc3c1fcbfb3418cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ce9 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.277263:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e707fe00/0xc3c1fcbfb3418cf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ce9 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.277271:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e707fe00, rc 0) 00000100:00100000:1.0:1789023749.277307:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14322:x1875927024881280:12345-0@lo:101:mount.lustre.0 Request processed in 123us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.277314:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789023749.277621:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024881280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789023749.277645:0:14322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04000/0xc3c1fcbfb3418ce9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418cf0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.277653:0:14322:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04000/0xc3c1fcbfb3418ce9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418cf0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023749.277703:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024881408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023749.277731:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.277743:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.277949:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881408 00000100:00100000:0.0:1789023749.277954:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881408 00000100:00100000:0.0:1789023749.277975:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789023749.277981:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14322:x1875927024881408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023749.278354:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14322:x1875927024881408:12345-0@lo:501:mount.lustre.0 Request processed in 371us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.278361:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789023749.278399:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024881408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023749.278428:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024881536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023749.278730:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.278746:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.278768:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881536 00000100:00100000:0.0:1789023749.278772:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881536 00000100:00100000:0.0:1789023749.278793:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789023749.278800:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14322:x1875927024881536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023749.278941:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14322:x1875927024881536:12345-0@lo:503:mount.lustre.0 Request processed in 140us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.278948:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789023749.281369:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024881536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023749.294056:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14371:1875927024881664:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023749.294157:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.294199:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881664 00000100:00100000:0.0:1789023749.294220:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881664 00000100:00100000:0.0:1789023749.294308:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023749.294316:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14371:x1875927024881664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023749.294617:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14371:x1875927024881664:12345-0@lo:502:llog_process_th.0 Request processed in 301us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.294625:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023749.294674:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e70a8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.294696:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14371:1875927024881664:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1789023749.294758:0:14371:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1789023749.294773:0:14371:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e65d071cd40) 00000020:00000080:0.0:1789023749.294791:0:14371:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1789023749.294857:0:14371:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65e74a3000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789023749.294866:0:14371:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65e74a3000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789023749.294868:0:14371:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65e74a3000 4 00010000:00080000:0.0:1789023749.294893:0:14371:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65e6d8d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789023749.296534:0:14371:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1789023749.296733:0:14371:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1789023749.296762:0:14371:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789023749.296774:0:14371:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc3c1fcbfb3418cfe 00000100:00080000:0.0:1789023749.296784:0:14371:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023749.296793:0:14371:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e65e6d8d000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789023749.296824:0:14371:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f7981f80 x1875927024881792/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789023749.296870:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024881792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789023749.296922:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789023749.296966:0:14371:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789023749.299234:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881792 00000100:00100000:3.0:1789023749.299248:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881792 00000100:00100000:3.0:1789023749.299289:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023749.299298:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875927024881792:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789023749.299378:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875927024881792:12345-0@lo:38:llog_process_th.0 Request processed in 80us (2455us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789023749.299385:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023749.307795:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789023749.307809:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e6d8d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789023749.307817:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789023749.307821:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024881792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789023749.307958:0:14371:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14371:1875927024881920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023749.308032:0:14371:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023749.308071:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024881920 00000100:00100000:0.0:1789023749.308078:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024881920 00000100:00100000:0.0:1789023749.308376:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023749.308385:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14371:x1875927024881920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789023749.308777:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14371:x1875927024881920:12345-0@lo:502:llog_process_th.0 Request processed in 390us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.308793:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789023749.308837:0:14371:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d1a4af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.308853:0:14371:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:96e4333f-cc82-4def-9373-4ed84d9f7775:14371:1875927024881920:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789023749.308875:0:14371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789023749.314426:0:14322:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789023749.314469:0:14322:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789023749.315317:0:14322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04000/0xc3c1fcbfb3418ce9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418cf0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023749.315332:0:14322:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04000/0xc3c1fcbfb3418ce9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418cf0 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789023749.315384:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789023749.315389:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023749.315391:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023749.315392:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023749.315393:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023749.315394:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023749.315395:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023749.315397:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023749.315398:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023749.315399:0:14322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789023749.315403:0:14322:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789023749.315405:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789023749.315406:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023749.315407:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023749.315408:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023749.315409:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023749.315410:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023749.315411:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023749.315411:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023749.315412:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023749.315413:0:14322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789023749.315440:0:14322:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789023749.315469:0:14322:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024882048:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789023749.315556:0:14322:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023749.315597:0:14322:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2b9d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023749.315979:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882048 00000100:00100000:1.0:1789023749.315987:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882048 00000100:00100000:1.0:1789023749.316035:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789023749.316045:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14322:x1875927024882048:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789023749.316094:0:14332:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789023749.316108:0:14332:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789023749.388355:0:14332:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789023749.388369:0:14332:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789023749.388399:0:14356:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789023749.388403:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789023749.388424:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.388449:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.388922:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.388963:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.388995:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 12 pid: 14333 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023749.389010:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875927024882176:0@lo:104: 00000100:00100000:3.0:1789023749.389884:0:14356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023749.389922:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7324600 going to sleep for 11 seconds 00000100:00100000:0.0:1789023749.390219:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882176 00000100:00100000:0.0:1789023749.390228:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882176 00000100:00100000:0.0:1789023749.390276:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789023749.390286:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14356:x1875927024882176:12345-0@lo:104: 00010000:00010000:0.0:1789023749.390300:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.390359:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023749.390365:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14356:x1875927024882176:12345-0@lo:104: Request processed in 81us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023749.390371:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789023749.390391:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023749.390396:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.390403:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f800 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023749.390408:0:14329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.390416:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023749.390424:0:14329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023749.391909:0:14329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023749.391947:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.391953:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023749.391975:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.391982:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418ccd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418cd4 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023749.391998:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023749.392000:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023749.392002:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023749.392025:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789023749.392037:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96e4333f-cc82-4def-9373-4ed84d9f7775:3310:1875927024882304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023749.392735:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875927024882176:0@lo:104: 00010000:00010000:3.0:1789023749.392757:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023749.393046:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023749.393631:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882304 00000100:00100000:1.0:1789023749.393641:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882304 00010000:00010000:1.0:1789023749.393667:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 13 pid: 14333 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023749.393706:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023749.393714:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+13:3310:x1875927024882304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789023749.393727:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023749.393732:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 13 pid: 14333 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393744:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 13 pid: 14333 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393784:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e707e200/0xc3c1fcbfb3418cd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ccd expref: 13 pid: 14333 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393799:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393808:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789023749.393823:0:14325:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005420521s 00010000:00010000:1.0:1789023749.393828:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393834:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393842:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393849:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393854:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023749.393859:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393866:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393877:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023749.393892:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023749.393931:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:3310:x1875927024882304:12345-0@lo:103:ldlm_bl.0 Request processed in 218us (885us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023749.393938:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789023749.394563:0:14356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.394574:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023749.394580:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023749.395004:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:96e4333f-cc82-4def-9373-4ed84d9f7775:3310:1875927024882304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023749.403903:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14322:x1875927024882048:12345-0@lo:253:mount.lustre.0 Request processed in 87850us (88338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023749.403918:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789023749.404070:0:14322:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:14322:1875927024882048:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789023749.404158:0:14322:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789023749.404162:0:14322:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789023749.404164:0:14322:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789023749.404165:0:14322:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023749.404166:0:14322:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023749.404167:0:14322:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023749.404168:0:14322:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023749.404170:0:14322:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789023749.404171:0:14322:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789023749.404172:0:14322:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023749.404183:0:14322:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789023749.404201:0:14322:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789023749.411225:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023749.411389:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023749.412315:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023749.413023:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023749.413392:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023749.413939:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023749.416201:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023749.416383:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023749.416738:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023749.417441:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023749.418236:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023749.418413:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789023749.513280:0:14322:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789023749.514039:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789023749.514329:0:14378:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789023749.514332:0:14378:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1789023749.514589:0:14379:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1789023749.514668:0:14379:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023749.522080:0:14379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789023749.522180:0:14379:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789023749.522193:0:14379:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:3.0:1789023749.532731:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789023749.533754:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789023749.536385:0:14322:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789023749.536403:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789023749.538274:0:14322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023749.541041:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789023749.542096:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789023749.542138:0:14322:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789023749.548408:0:14322:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1789023749.570104:0:14322:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789023749.639910:0:14322:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789023749.640037:0:14322:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9c3b41b5f988 00100000:10000000:2.0:1789023749.640044:0:14322:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789023749.645791:0:14322:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789023749.645807:0:14322:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789023749.645818:0:14322:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789023749.645837:0:14322:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789023749.852659:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789023750.025887:0:14337:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789023750.025894:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65e74a3000 from 6 10000000:01000000:1.0:1789023750.025898:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789023750.025942:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023750.025953:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023750.025965:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023750.025987:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024882432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023750.026049:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023750.026100:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023750.026313:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882432 00000100:00100000:0.0:1789023750.026321:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882432 00000100:00100000:0.0:1789023750.026372:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789023750.026381:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14337:x1875927024882432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023750.026393:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023750.026406:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418d0c expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023750.026428:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023750.026439:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023750.026462:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04e00, rc 0) 00000100:00100000:0.0:1789023750.026528:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024882432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023750.026534:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789023750.026666:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024882432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023750.026680:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023750.026689:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023750.026745:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024882560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789023750.026786:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023750.026818:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789023750.026903:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882560 00000100:00100000:2.0:1789023750.026908:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882560 00000100:00100000:2.0:1789023750.026929:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789023750.026935:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024882560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789023750.026947:0:14332:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789023750.026960:0:14332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789023750.026963:0:14332:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789023750.027044:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024882560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023750.027051:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789023750.028027:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024882560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789023750.028085:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789023750.028094:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023750.028104:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789023750.349375:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789023750.869151:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789023751.370560:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789023751.881665:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023752.906637:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023753.929968:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789023754.762566:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789023754.762573:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789023754.762575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789023754.762578:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789023754.762581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789023754.762584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789023754.762588:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e65e6d8d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789023754.762603:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e65e6d8d000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789023754.762627:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f7982a00 x1875927024882816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789023754.763056:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789023754.763070:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024882688:0@lo:400:kworker.0 00000100:00100000:3.0:1789023754.763133:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023754.763313:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024882816:0@lo:38:kworker.0 00000100:00100000:2.0:1789023754.763349:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023754.763443:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882688 00000100:00100000:2.0:1789023754.763452:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882688 00000100:00100000:2.0:1789023754.763514:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023754.763524:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:3313:x1875927024882688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023754.763573:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:3313:x1875927024882688:12345-0@lo:400:kworker.0 Request processed in 51us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023754.763581:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789023754.763864:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024882688:0@lo:400:kworker.0 00000100:00100000:3.0:1789023754.764332:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882816 00000100:00100000:3.0:1789023754.764338:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882816 00000100:00100000:3.0:1789023754.764358:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023754.764364:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875927024882816:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789023754.764385:0:14342:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:3.0:1789023754.764421:0:14342:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc3c1fcbfb3418d1a 00000004:00100000:3.0:1789023754.764434:0:14342:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789023754.764578:0:14342:0:(import.c:65:import_set_state_nolock()) ffff8e65d234c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789023754.764624:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875927024882816:12345-0@lo:38:kworker.0 Request processed in 259us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023754.764632:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789023754.765111:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e65f7982a00 x1875927024882816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789023754.765126:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789023754.765133:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789023754.765138:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789023754.765140:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e6d8d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789023754.765145:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875927024882816:0@lo:38:kworker.0 00010000:00010000:0.0:1789023754.956199:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789023755.031905:0:14622:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789023755.979991:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023757.001646:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023758.026414:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789023758.103847:0:14772:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc24d0f4b0 20000000:00000080:1.0:1789023758.103866:0:14772:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e65fd9ff400 uarg=0000000000000000 20000000:01000000:1.0:1789023758.103898:0:14772:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789023758.103906:0:14772:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789023758.103910:0:14772:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789023758.108059:0:14773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1789023758.108252:0:14772:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789023758.114033:0:14772:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789023758.114063:0:14772:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023758.114082:0:14772:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 11 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023758.114091:0:14772:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023758.114127:0:14772:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 11 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023758.114146:0:14772:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 11 pid: 14332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023758.114173:0:14772:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14772:1875927024882944:0@lo:104: 00000100:00100000:1.0:1789023758.114236:0:14772:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023758.114377:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024882944 00000100:00100000:2.0:1789023758.114385:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024882944 00000100:00100000:1.0:1789023758.114386:0:14772:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023758.114433:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023758.114441:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14772:x1875927024882944:12345-0@lo:104: 00010000:00010000:2.0:1789023758.114451:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023758.114523:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789023758.114530:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14772:x1875927024882944:12345-0@lo:104: Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023758.114537:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023758.114620:0:14772:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14772:1875927024882944:0@lo:104: 00010000:00010000:1.0:1789023758.114640:0:14772:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.114749:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023758.114755:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.114761:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e400 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023758.114763:0:14329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.114774:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023758.114778:0:14329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023758.114782:0:14329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789023758.114874:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.114880:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023758.114902:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.114910:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e707e400/0xc3c1fcbfb3418cdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418ce2 expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023758.114921:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1789023758.114926:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023758.114928:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023758.114930:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023758.114932:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024883072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789023758.114962:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023758.114995:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024883072 00000100:00100000:0.0:1789023758.115000:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024883072 00010000:00010000:0.0:1789023758.115019:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 12 pid: 14332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023758.115044:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789023758.115049:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:3312:x1875927024883072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789023758.115056:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023758.115059:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 12 pid: 14332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115070:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 12 pid: 14332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115079:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e707fa00/0xc3c1fcbfb3418ce2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3418cdb expref: 12 pid: 14332 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115093:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115098:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115107:0:14325:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115111:0:14325:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115115:0:14325:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115120:0:14325:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115123:0:14325:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ec00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023758.115125:0:14325:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115129:0:14325:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115147:0:14325:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023758.115165:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023758.115174:0:14772:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023758.115182:0:14772:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023758.115188:0:14772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e707ec00/0xc3c1fcbfb3418d21 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14772 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023758.115212:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+11:3312:x1875927024883072:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023758.115227:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023758.115251:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024883072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789023759.049649:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789023759.438094:0:14337:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789023759.438106:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65e74a3000 from 10 10000000:01000000:1.0:1789023759.438114:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789023759.438184:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023759.438198:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023759.438221:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023759.438257:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024883200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023759.438343:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023759.438399:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aef00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023759.439132:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024883200 00000100:00100000:0.0:1789023759.439155:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024883200 00000100:00100000:0.0:1789023759.439242:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789023759.439254:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+11:14337:x1875927024883200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023759.439273:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023759.439294:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418d28 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023759.439327:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023759.439340:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023759.439350:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04a00, rc 0) 00000100:00100000:0.0:1789023759.439423:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024883200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (1079us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023759.439430:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789023759.443191:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024883200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023759.443233:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023759.443248:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023759.443362:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024883328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023759.443439:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023759.443680:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aef00 going to sleep for 11 seconds 00000100:00100000:3.0:1789023759.450644:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024883328 00000100:00100000:3.0:1789023759.450666:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024883328 00000100:00100000:3.0:1789023759.450842:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023759.450856:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024883328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023759.451343:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024883328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 490us (7903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023759.451353:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789023759.451439:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024883328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023759.452137:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024883456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023759.452218:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023759.452310:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f40b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023759.460292:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024883456 00000100:00100000:2.0:1789023759.460313:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024883456 00000100:00100000:2.0:1789023759.460391:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789023759.460403:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024883456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023759.460747:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+12:14337:x1875927024883456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 345us (8527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023759.460756:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789023759.463271:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024883456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789023759.464056:0:14816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789023759.464149:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789023759.464181:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789023759.464195:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023759.464209:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023759.882380:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789023749/real 1789023749] req@ffff8e65c84c0e00 x1875927024880128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023759 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789023759.882409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023759.882421:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789023759.882424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023759.882426:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789023759.882512:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023759.882533:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024883584:0@lo:400:kworker.0 00000100:00100000:3.0:1789023759.886759:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e65c84c0e00 x1875927024880128/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023759 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023759.886791:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789023749/real 1789023749] req@ffff8e65c84c2a00 x1875927024880000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023759 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023759.891095:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023759.891203:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024883584 00000100:00100000:2.0:1789023759.893034:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024883584 00000100:00100000:2.0:1789023759.893123:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023759.893156:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024883584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023759.893254:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024883584:12345-0@lo:400:kworker.0 Request processed in 101us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023759.893261:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789023759.893312:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e64c18ddc00 x1875927024883584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023775 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023759.893327:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024883584:0@lo:400:kworker.0 00000100:00100000:3.0:1789023759.893935:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e65c84c2a00 x1875927024880000/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023759 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789023759.893952:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789023759.893975:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789023759.893979:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024880128:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789023759.894587:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65f78e7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789023759.894597:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789023759.894601:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024880000:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789023759.895806:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023759.895814:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789023759.895827:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e65f78e7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789023759.895833:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1789023759.895839:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789023759.895849:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e65f78e7000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789023759.895884:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e64c18ddc00 x1875927024883712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789023759.895898:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023759.895901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789023759.895902:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789023759.895905:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1789023759.895907:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789023759.895911:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e65e64e8000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789023759.895920:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e64c18dce00 x1875927024883840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789023759.903846:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024883712:0@lo:8:kworker.0 00000400:00000100:3.0:1789023759.903908:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927024883712 offset 0 length 520: 4 00000100:00100000:3.0:1789023759.903955:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024883840:0@lo:8:kworker.0 00000400:00000100:3.0:1789023759.904019:0:3309:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875927024883840 offset 0 length 520: 4 00010000:00010000:0.0:1789023760.074725:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023761.098747:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789023761.610398:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789023762.123211:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023763.146652:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789023763.804068:0:15021:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789023763.804071:0:15021:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789023763.804176:0:15021:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e65e6d8b800 00000020:01000004:0.0:1789023763.804191:0:15021:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789023763.804202:0:15021:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789023763.804215:0:15021:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e65d0718000) 00000020:00000080:0.0:1789023763.804229:0:15021:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789023763.817043:0:15021:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789023763.817351:0:15021:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1789023763.818387:0:15021:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1789023763.818672:0:15021:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1789023763.818912:0:15021:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1789023763.819246:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 113: rc = 0 00100000:10000000:1.0:1789023763.819337:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 113: rc = 0 00100000:10000000:1.0:1789023763.819432:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 113: rc = 0 00100000:10000000:1.0:1789023763.819860:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 772: rc = 0 00100000:10000000:1.0:1789023763.820238:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 772: rc = 0 00100000:10000000:1.0:1789023763.820581:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 772: rc = 0 00100000:10000000:1.0:1789023763.820820:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 772: rc = 0 00100000:10000000:1.0:1789023763.821052:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 772: rc = 0 00100000:10000000:1.0:1789023763.821301:0:15021:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 772: rc = 0 00000020:00000080:1.0:1789023763.821863:0:15021:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789023763.821874:0:15021:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789023763.821884:0:15021:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3c1fcbfb3418d3d 00000020:01000004:1.0:1789023763.821893:0:15021:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1789023763.821914:0:15021:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789023763.821918:0:15021:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789023763.821924:0:15021:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789023763.821929:0:15021:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789023763.821940:0:15021:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e65d2720000) 00000020:00000080:1.0:1789023763.821951:0:15021:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1789023763.823239:0:15021:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023763.823389:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789023763.823395:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789023763.824204:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789023763.824212:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789023763.824651:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789023763.824658:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789023763.827641:0:15021:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023763.828414:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789023763.828421:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789023763.829437:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789023763.829444:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789023763.849086:0:15021:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789023763.849938:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789023763.849947:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789023763.852872:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789023763.852886:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789023763.854899:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789023763.854911:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789023763.859344:0:15021:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789023763.859670:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789023763.859677:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789023763.861672:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789023763.861684:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789023763.905941:0:15021:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789023763.906167:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789023763.906173:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789023763.909063:0:15021:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789023763.909164:0:15021:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789023763.909957:0:15021:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789023763.909983:0:15021:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789023763.909989:0:15021:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789023763.928234:0:15021:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789023763.928274:0:15021:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.148@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789023763.928278:0:15021:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789023763.928280:0:15021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789023763.928282:0:15021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023763.928283:0:15021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023763.928285:0:15021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023763.928286:0:15021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023763.928287:0:15021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023763.928289:0:15021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023763.928290:0:15021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789023763.928295:0:15021:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789023763.928297:0:15021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789023763.928298:0:15021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789023763.928299:0:15021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789023763.928300:0:15021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789023763.928301:0:15021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789023763.928302:0:15021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789023763.928303:0:15021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789023763.928304:0:15021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789023763.928305:0:15021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789023763.928330:0:15021:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789023763.928413:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024883968:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789023763.928632:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023763.928739:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.928944:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024883968 00000100:00100000:0.0:1789023763.928952:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024883968 00000100:00100000:0.0:1789023763.929039:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023763.929047:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+12:15021:x1875927024883968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789023763.929084:0:14334:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789023763.929086:0:14334:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789023763.929090:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789023763.940288:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+12:15021:x1875927024883968:12345-0@lo:253:mount.lustre.0 Request processed in 11233us (11648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023763.940303:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789023763.940443:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024883968:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789023763.940458:0:15021:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789023763.940461:0:15021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023763.940463:0:15021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789023763.940464:0:15021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023763.940465:0:15021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023763.940467:0:15021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023763.940467:0:15021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023763.940469:0:15021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023763.940470:0:15021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023763.940472:0:15021:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789023763.940662:0:15021:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e65e6d8b800 from lustre-OST0000 10000000:01000000:0.0:1789023763.940779:0:15021:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789023763.940782:0:15021:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789023763.940789:0:15021:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e65f00419c0 local copy 00010000:00010000:0.0:1789023763.940799:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023763.941009:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884096:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023763.941043:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023763.941119:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d00dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789023763.941164:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884096 00000100:00100000:3.0:1789023763.941171:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884096 00000100:00100000:3.0:1789023763.941238:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789023763.941248:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:15021:x1875927024884096:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789023763.941454:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+12:15021:x1875927024884096:12345-0@lo:501:mount.lustre.0 Request processed in 207us (409us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789023763.941461:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789023763.941765:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884096:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789023763.941778:0:15021:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789023763.941959:0:15021:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789023763.941966:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.941987:0:15021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023763.942006:0:15021:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e65e6d8b800 10000000:01000000:0.0:1789023763.942011:0:15021:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789023763.942016:0:15021:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e65f00419c0 10000000:01000000:0.0:1789023763.942018:0:15021:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789023763.942021:0:15021:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8e65f00419c0 from 1 10000000:01000000:0.0:1789023763.942024:0:15021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789023763.942049:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04200/0xc3c1fcbfb3418d4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.942057:0:15021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04200/0xc3c1fcbfb3418d4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.942067:0:15021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04200/0xc3c1fcbfb3418d4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023763.942080:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789023763.942108:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023763.942145:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d00dd240 going to sleep for 11 seconds 00000100:00100000:2.0:1789023763.942199:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884224 00000100:00100000:2.0:1789023763.942204:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884224 00000100:00100000:2.0:1789023763.942274:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789023763.942288:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+12:15021:x1875927024884224:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789023763.942299:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023763.942320:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d06800/0xc3c1fcbfb3418d52 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418d4b expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023763.942408:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d06800/0xc3c1fcbfb3418d52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d4b expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023763.942420:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d06800/0xc3c1fcbfb3418d52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d4b expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023763.942429:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06800, rc 0) 00000100:00100000:2.0:1789023763.942464:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+13:15021:x1875927024884224:12345-0@lo:101:mount.lustre.0 Request processed in 177us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023763.942470:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789023763.942594:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789023763.942607:0:15021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04200/0xc3c1fcbfb3418d4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d52 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.942616:0:15021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04200/0xc3c1fcbfb3418d4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418d52 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023763.942647:0:15021:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789023763.942658:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04200/0xc3c1fcbfb3418d4b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d52 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.942664:0:15021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04200/0xc3c1fcbfb3418d4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d52 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023763.942671:0:15021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789023763.942675:0:15021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789023763.942680:0:15021:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789023763.942683:0:15021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789023763.942697:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05800/0xc3c1fcbfb3418d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.942703:0:15021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05800/0xc3c1fcbfb3418d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.942710:0:15021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05800/0xc3c1fcbfb3418d59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023763.942722:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884352:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789023763.942746:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023763.942766:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884352 00000100:00100000:0.0:1789023763.942772:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d00dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789023763.942776:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884352 00000100:00100000:3.0:1789023763.942803:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789023763.942811:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+13:15021:x1875927024884352:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789023763.942819:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023763.942828:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418d59 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023763.942844:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d59 expref: 14 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023763.942853:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713d400/0xc3c1fcbfb3418d60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d59 expref: 14 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023763.942860:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d400, rc 0) 00000100:00100000:3.0:1789023763.942900:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884352:12345-0@lo:101:mount.lustre.0 Request processed in 91us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023763.942906:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789023763.942974:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884352:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789023763.942983:0:15021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05800/0xc3c1fcbfb3418d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d60 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.942988:0:15021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05800/0xc3c1fcbfb3418d59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418d60 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789023763.943556:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789023763.944242:0:15021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789023763.944522:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789023763.944565:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789023763.944601:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789023763.944656:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789023763.944691:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789023763.944722:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789023763.944783:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789023763.944790:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789023763.944860:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023763.944911:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023763.944951:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d00dd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023763.944957:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884480 00000100:00100000:2.0:1789023763.944964:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884480 00000100:00100000:2.0:1789023763.945004:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789023763.945013:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884480:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789023763.946473:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884480:12345-0@lo:501:mount.lustre.0 Request processed in 1327us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023763.946598:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789023763.947025:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884480:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023763.948298:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884608:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023763.948379:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023763.948434:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d00dd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023763.948593:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884608 00000100:00100000:3.0:1789023763.948601:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884608 00000100:00100000:3.0:1789023763.948651:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789023763.948661:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884608:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789023763.949077:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884608:12345-0@lo:503:mount.lustre.0 Request processed in 416us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023763.949086:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789023763.949167:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884608:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789023763.950133:0:15021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789023763.950207:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884736:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789023763.950262:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023763.950301:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.950316:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884736 00000100:00100000:0.0:1789023763.950323:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884736 00000100:00100000:0.0:1789023763.950368:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789023763.950376:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884736:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789023763.950606:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884736:12345-0@lo:502:mount.lustre.0 Request processed in 231us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023763.950613:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789023763.950674:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884736:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789023763.950899:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789023763.950947:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789023763.950984:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789023763.951035:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789023763.951083:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789023763.951132:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789023763.951189:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789023763.951227:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789023763.951274:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789023763.951338:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789023763.951883:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789023763.951943:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789023763.951984:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884864:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023763.952036:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023763.952071:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c574ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.952172:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884864 00000100:00100000:0.0:1789023763.952179:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884864 00000100:00100000:0.0:1789023763.952260:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789023763.952269:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789023763.952473:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884864:12345-0@lo:502:mount.lustre.0 Request processed in 205us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023763.952500:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789023763.952590:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884864:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789023763.952654:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789023763.952663:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789023763.954367:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789023763.954377:0:15035:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789023763.954383:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.954386:0:15035:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789023763.954391:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789023763.954406:0:15035:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e65d2724d40) 00000020:00000080:1.0:1789023763.954426:0:15035:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789023763.954433:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789023763.954949:0:15035:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65e6d8b800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789023763.954958:0:15035:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789023763.954967:0:15035:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc3c1fcbfb3418d6e 00010000:00010000:1.0:1789023763.964323:0:15035:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789023763.965170:0:15035:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1789023763.970725:0:15035:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789023763.973135:0:15035:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789023763.973146:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023763.973153:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.973156:0:15035:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789023763.973160:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789023763.973163:0:15035:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789023763.973165:0:15035:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789023763.973174:0:15035:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789023763.973176:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789023763.973191:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.973193:0:15035:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789023763.973197:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023763.973200:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.973202:0:15035:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789023763.973205:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789023763.973207:0:15035:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789023763.973209:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023763.973213:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.973214:0:15035:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789023763.973217:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023763.973220:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.973222:0:15035:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789023763.973227:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789023763.973406:0:15035:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023763.973411:0:15035:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.973412:0:15035:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789023763.973416:0:15035:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789023763.973648:0:15021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789023763.973676:0:15021:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789023763.973695:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05800/0xc3c1fcbfb3418d59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d60 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.973706:0:15021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05800/0xc3c1fcbfb3418d59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d60 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023763.973713:0:15021:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65e6d8b800 from 1 10000000:01000000:0.0:1789023763.973716:0:15021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023763.973749:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.973758:0:15021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.973768:0:15021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023763.973982:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789023763.974046:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023763.974124:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2b6b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789023763.974173:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024884992 00000100:00100000:2.0:1789023763.974246:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024884992 00000100:00100000:2.0:1789023763.974342:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789023763.974354:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+14:15021:x1875927024884992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789023763.974368:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023763.974384:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418d75 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023763.974412:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 15 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023763.974423:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 15 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023763.974431:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07200, rc 0) 00000100:00100000:2.0:1789023763.974508:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024884992:12345-0@lo:101:mount.lustre.0 Request processed in 157us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023763.974525:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789023763.974692:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7982a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024884992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023763.974710:0:15021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023763.974720:0:15021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789023763.975301:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789023763.975618:0:15021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023763.975841:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789023763.975885:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789023763.975928:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789023763.975932:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789023763.975986:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023763.976025:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023763.976750:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.976867:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024885120 00000100:00100000:0.0:1789023763.976874:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024885120 00000100:00100000:0.0:1789023763.976919:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789023763.976927:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885120:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789023763.977169:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885120:12345-0@lo:501:mount.lustre.0 Request processed in 240us (1140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023763.977287:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023763.977326:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789023763.977368:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023763.977378:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.977440:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789023763.977468:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024885248 00000100:00100000:0.0:1789023763.977471:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024885248 00000100:00100000:0.0:1789023763.977660:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789023763.977669:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885248:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023763.977818:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885248:12345-0@lo:503:mount.lustre.0 Request processed in 150us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023763.977825:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789023763.978045:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885248:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789023763.978850:0:15021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023763.978922:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023763.978972:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023763.978999:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.979071:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024885376 00000100:00100000:0.0:1789023763.979077:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024885376 00000100:00100000:0.0:1789023763.979126:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789023763.979133:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885376:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789023763.979365:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885376:12345-0@lo:502:mount.lustre.0 Request processed in 231us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023763.979373:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789023763.979666:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789023763.979995:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789023763.980042:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789023763.980086:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789023763.980132:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789023763.980167:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789023763.980927:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789023763.980991:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789023763.981030:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789023763.981071:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023763.981141:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023763.981305:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322000 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.981382:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024885504 00000100:00100000:0.0:1789023763.981389:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024885504 00000100:00100000:0.0:1789023763.981462:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789023763.981471:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885504:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789023763.981719:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885504:12345-0@lo:502:mount.lustre.0 Request processed in 247us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023763.981727:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789023763.982813:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789023763.982975:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789023763.983064:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789023763.992651:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023763.992665:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.992737:0:15039:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789023763.992747:0:15039:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65e6d8b800 00000020:00000080:1.0:1789023763.992749:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789023763.992757:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023763.992760:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.992761:0:15039:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789023763.992764:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023763.992766:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.992768:0:15039:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789023763.992771:0:15039:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e65e6d8b800 00000020:00000080:1.0:1789023763.992774:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789023763.992830:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023763.992834:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.992835:0:15039:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789023763.992837:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023763.992840:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.992841:0:15039:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789023763.992845:0:15039:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e65e6d8b800 00000020:00000080:1.0:1789023763.992847:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789023763.992884:0:15039:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023763.992887:0:15039:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023763.992888:0:15039:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789023763.992891:0:15039:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789023763.996488:0:15021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789023763.996530:0:15021:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789023763.996553:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023763.996576:0:15021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023763.996620:0:15021:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789023763.996623:0:15021:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e65e6d8b800 10000000:01000000:3.0:1789023763.996626:0:15021:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e65e6d8b800 10000000:01000000:3.0:1789023763.996630:0:15021:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789023763.996635:0:15021:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e65e6d8b800 from 1 10000000:01000000:3.0:1789023763.996638:0:15021:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789023763.996685:0:15021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713dc00/0xc3c1fcbfb3418d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023763.996694:0:15021:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713dc00/0xc3c1fcbfb3418d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023763.996706:0:15021:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713dc00/0xc3c1fcbfb3418d83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023763.996729:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789023763.997091:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023763.997150:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024885632 00000100:00100000:3.0:1789023763.997154:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023763.997158:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024885632 00000100:00100000:0.0:1789023763.997262:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789023763.997273:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024885632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789023763.997288:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023763.997311:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3418d8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418d83 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.997336:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3418d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d83 expref: 16 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.997347:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d05000/0xc3c1fcbfb3418d8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d83 expref: 16 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023763.997356:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05000, rc 0) 00000100:00100000:0.0:1789023763.997411:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024885632:12345-0@lo:101:mount.lustre.0 Request processed in 137us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023763.997418:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789023763.997526:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789023763.997540:0:15021:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713dc00/0xc3c1fcbfb3418d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d8a expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023763.997560:0:15021:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713dc00/0xc3c1fcbfb3418d83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418d8a expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789023763.998258:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789023763.998761:0:15021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023763.999055:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789023763.999122:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789023763.999181:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789023763.999222:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789023763.999246:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789023763.999276:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789023763.999295:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789023763.999311:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789023763.999335:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789023763.999352:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789023763.999368:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789023763.999391:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789023763.999408:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789023763.999424:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789023763.999447:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789023763.999471:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789023763.999533:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789023763.999596:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789023763.999651:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789023763.999858:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789023763.999909:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789023763.999949:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789023763.999985:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789023764.000035:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789023764.000076:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789023764.000125:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789023764.000182:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789023764.000220:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789023764.000304:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789023764.000318:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789023764.000409:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789023764.000467:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023764.000520:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023764.001415:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024885760 00000100:00100000:1.0:1789023764.001425:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024885760 00000100:00100000:1.0:1789023764.001494:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789023764.001504:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024885760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023764.001763:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024885760:12345-0@lo:501:mount.lustre.0 Request processed in 261us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023764.001780:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789023764.001858:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789023764.001940:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789023764.001983:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023764.002015:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023764.002594:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024885888 00000100:00100000:0.0:1789023764.002602:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024885888 00000100:00100000:0.0:1789023764.002638:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789023764.002648:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024885888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023764.003362:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024885888:12345-0@lo:503:mount.lustre.0 Request processed in 713us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023764.003371:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789023764.003715:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024885888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789023764.004739:0:15021:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789023764.004824:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024886016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789023764.004876:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023764.004912:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023764.004918:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886016 00000100:00100000:1.0:1789023764.004925:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886016 00000100:00100000:1.0:1789023764.004975:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789023764.004985:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024886016:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023764.005269:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024886016:12345-0@lo:502:mount.lustre.0 Request processed in 285us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023764.005406:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789023764.005929:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024886016:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789023764.006263:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789023764.006325:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789023764.006391:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789023764.006582:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789023764.006634:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789023764.006711:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1789023764.006752:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1789023764.006805:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1789023764.006886:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1789023764.006948:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1789023764.007005:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1789023764.007075:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1789023764.007131:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1789023764.007167:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1789023764.007232:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1789023764.007285:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1789023764.007323:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1789023764.007388:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1789023764.007600:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1789023764.007631:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1789023764.007680:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1789023764.007718:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1789023764.007749:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1789023764.007795:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1789023764.007830:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1789023764.007866:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1789023764.007920:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1789023764.007974:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1789023764.008025:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1789023764.008076:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1789023764.008125:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1789023764.008153:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1789023764.008192:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1789023764.008242:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1789023764.008296:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1789023764.008342:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1789023764.008380:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1789023764.008421:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1789023764.008473:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1789023764.008540:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1789023764.008594:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024886144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789023764.008669:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023764.008709:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023764.009353:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886144 00000100:00100000:0.0:1789023764.009362:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886144 00000100:00100000:0.0:1789023764.009415:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789023764.009426:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024886144:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789023764.009748:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024886144:12345-0@lo:502:mount.lustre.0 Request processed in 314us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023764.009757:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789023764.010400:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024886144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789023764.010572:0:15021:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1789023764.010596:0:15021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789023764.012730:0:15044:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789023764.012750:0:15044:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e65d2723380) 00000020:00000080:1.0:1789023764.012770:0:15044:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789023764.012839:0:15044:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e65e6d8b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789023764.012844:0:15044:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e65e6d8b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789023764.012847:0:15044:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e65e6d8b800 3 00010000:00080000:1.0:1789023764.012876:0:15044:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65c84a6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.148@tcp at head 00010000:00010000:1.0:1789023764.015221:0:15044:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789023764.015463:0:15044:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789023764.015546:0:15044:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789023764.015558:0:15044:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc3c1fcbfb3418d98 00000100:00080000:1.0:1789023764.015568:0:15044:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789023764.015578:0:15044:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e65c84a6800 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789023764.015626:0:15044:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f6c94700 x1875927024886272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789023764.015663:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875927024886272:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789023764.015795:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023764.015853:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886272 00000100:00100000:1.0:1789023764.015862:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886272 00000100:00100000:1.0:1789023764.015891:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023764.015898:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1875927024886272:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789023764.016046:0:14340:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1789023764.016083:0:14340:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc3c1fcbfb3418d9f 00000004:00100000:1.0:1789023764.016096:0:14340:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789023764.016141:0:14340:0:(import.c:65:import_set_state_nolock()) ffff8e65d006d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023764.016191:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875927024886272:12345-0@lo:38:llog_process_th.0 Request processed in 292us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023764.016199:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789023764.016235:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e65f6c94700 x1875927024886272/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023764.016245:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789023764.016252:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1789023764.016258:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789023764.016262:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789023764.016265:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65c84a6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789023764.016347:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1875927024886272:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789023764.016368:0:15044:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789023764.016740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023764.016745:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789023764.016748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023764.016751:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789023764.016794:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024886400:0@lo:400:kworker.0 00000100:00100000:2.0:1789023764.016825:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023764.016855:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886400 00000100:00100000:2.0:1789023764.016859:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886400 00000100:00100000:2.0:1789023764.016885:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023764.016896:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024886400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023764.016932:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024886400:12345-0@lo:400:kworker.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023764.016938:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789023764.016962:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e64c18dea00 x1875927024886400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789023764.016973:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024886400:0@lo:400:kworker.0 00000040:00080000:0.0:1789023764.018743:0:15044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1789023764.018842:0:15021:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789023764.018867:0:15021:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789023764.018883:0:15021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713dc00/0xc3c1fcbfb3418d83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d8a expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.018892:0:15021:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713dc00/0xc3c1fcbfb3418d83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418d8a expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789023764.018924:0:15021:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789023764.018925:0:15021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789023764.018926:0:15021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023764.018927:0:15021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023764.018928:0:15021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023764.018929:0:15021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023764.018930:0:15021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023764.018931:0:15021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023764.018932:0:15021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789023764.018934:0:15021:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789023764.018936:0:15021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789023764.018937:0:15021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789023764.018937:0:15021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023764.018938:0:15021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023764.018939:0:15021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023764.018939:0:15021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023764.018940:0:15021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023764.018941:0:15021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023764.018941:0:15021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789023764.018959:0:15021:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789023764.019051:0:15021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024886528:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789023764.019099:0:15021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023764.019144:0:15021:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023764.019144:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886528 00000100:00100000:0.0:1789023764.019151:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886528 00000100:00100000:0.0:1789023764.019190:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789023764.019200:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15021:x1875927024886528:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789023764.019225:0:14332:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789023764.019238:0:14332:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789023764.050316:0:14332:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789023764.050335:0:14332:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1789023764.050387:0:14356:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789023764.050406:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789023764.050427:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.050446:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.050454:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.050521:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.050537:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 16 pid: 14334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023764.050551:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875927024886656:0@lo:104: 00000100:00100000:3.0:1789023764.050614:0:14356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023764.050655:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023764.051049:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886656 00000100:00100000:0.0:1789023764.051058:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886656 00000100:00100000:0.0:1789023764.051107:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789023764.051127:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14356:x1875927024886656:12345-0@lo:104: 00010000:00010000:0.0:1789023764.051139:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023764.051190:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789023764.051195:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14356:x1875927024886656:12345-0@lo:104: Request processed in 71us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023764.051202:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789023764.051218:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023764.051223:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023764.051230:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ea00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:0.0:1789023764.051241:0:14329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023764.051249:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789023764.051256:0:14329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023764.051262:0:14329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789023764.051286:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023764.051291:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789023764.051306:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023764.051313:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e707ea00/0xc3c1fcbfb3418d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d13 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023764.051325:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023764.051327:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023764.051328:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023764.051416:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024886784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023764.051442:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023764.051505:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886784 00000100:00100000:3.0:1789023764.051509:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886784 00010000:00010000:3.0:1789023764.051525:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 17 pid: 14334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023764.051543:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789023764.051547:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:3312:x1875927024886784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023764.051556:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023764.051560:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 17 pid: 14334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051574:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 17 pid: 14334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051590:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051597:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789023764.051608:0:14327:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005420521s 00010000:00010000:3.0:1789023764.051612:0:14327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051619:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051626:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051632:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051637:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713de00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023764.051640:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051646:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051653:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051666:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023764.051746:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:3312:x1875927024886784:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023764.051752:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789023764.051782:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024886784:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023764.051805:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04e00/0xc3c1fcbfb3418d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d0c expref: 16 pid: 14334 timeout: 530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023764.051814:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875927024886656:0@lo:104: 00010000:00010000:3.0:1789023764.051825:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051833:0:14356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051840:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023764.051847:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713de00/0xc3c1fcbfb3418da6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023764.056964:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+15:15021:x1875927024886528:12345-0@lo:253:mount.lustre.0 Request processed in 37757us (37855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023764.056979:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789023764.057058:0:15021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15021:1875927024886528:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789023764.057072:0:15021:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789023764.057075:0:15021:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789023764.057077:0:15021:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789023764.057078:0:15021:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023764.057079:0:15021:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023764.057080:0:15021:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023764.057094:0:15021:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023764.057095:0:15021:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023764.057097:0:15021:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023764.057098:0:15021:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789023764.057121:0:15021:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789023764.060277:0:15021:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023764.060400:0:15021:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023764.061038:0:15021:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023764.061229:0:15021:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789023764.061371:0:15021:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789023764.061584:0:15021:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789023764.062373:0:15021:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789023764.093641:0:15021:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789023764.093650:0:15021:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789023764.093679:0:15021:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789023764.093733:0:15021:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789023764.093746:0:15021:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789023764.093772:0:15021:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789023764.169743:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023765.193774:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789023765.460779:0:14337:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789023765.460785:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65e74a3000 from 7 10000000:01000000:1.0:1789023765.460789:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789023765.460825:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023765.460837:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023765.460859:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023765.460883:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024886912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789023765.460938:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023765.460986:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c574a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789023765.463154:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024886912 00000100:00100000:0.0:1789023765.463168:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024886912 00000100:00100000:0.0:1789023765.463219:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789023765.463229:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+15:14337:x1875927024886912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023765.463245:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023765.463262:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418dad expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023765.463296:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023765.463306:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023765.463315:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04400, rc 0) 00000100:00100000:0.0:1789023765.463385:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+16:14337:x1875927024886912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023765.463391:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789023765.463441:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024886912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023765.463457:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023765.463466:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023765.463539:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024887040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789023765.463576:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023765.463592:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2287a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023765.464148:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887040 00000100:00100000:2.0:1789023765.464155:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887040 00000100:00100000:2.0:1789023765.464184:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789023765.464191:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:14337:x1875927024887040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789023765.464214:0:14332:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789023765.464227:0:14332:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789023765.464230:0:14332:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789023765.464311:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:14337:x1875927024887040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023765.464318:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789023765.464357:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024887040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789023765.464408:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789023765.464416:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023765.464424:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023766.217689:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023767.247942:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023768.275959:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789023769.102831:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789023769.102838:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789023769.102841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789023769.102844:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789023769.102941:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024887296:0@lo:400:kworker.0 00000100:00100000:1.0:1789023769.103008:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023769.103069:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023769.103075:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024887424:0@lo:400:kworker.0 00000100:00100000:1.0:1789023769.103108:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023769.103141:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887296 00000100:00100000:1.0:1789023769.103148:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887296 00000100:00100000:1.0:1789023769.103260:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887424 00000100:00100000:1.0:1789023769.103264:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887424 00000100:00100000:1.0:1789023769.103289:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023769.103297:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024887296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023769.103344:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024887296:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023769.103350:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023769.103380:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023769.103386:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024887424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023769.103413:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024887424:12345-0@lo:400:kworker.0 Request processed in 28us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023769.103419:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789023769.103450:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f6c95f80 x1875927024887424/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023769.103462:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024887424:0@lo:400:kworker.0 00010000:00080000:1.0:1789023769.103472:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f6c97100 x1875927024887296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023785 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023769.103497:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024887296:0@lo:400:kworker.0 00000100:00100000:3.0:1789023769.103731:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024887168:0@lo:400:kworker.0 00000100:00100000:3.0:1789023769.103765:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789023769.103818:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023769.103869:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887168 00000100:00100000:2.0:1789023769.103874:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887168 00000100:00100000:2.0:1789023769.103908:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789023769.103915:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:3313:x1875927024887168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789023769.103951:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:3313:x1875927024887168:12345-0@lo:400:kworker.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023769.103957:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789023769.106002:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024887168:0@lo:400:kworker.0 00010000:00010000:3.0:1789023769.289667:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789023770.227994:0:15389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789023770.314764:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023771.351810:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789023771.850090:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789023772.361679:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023773.385955:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789023774.217611:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789023774.217618:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789023774.217621:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789023774.217624:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789023774.217708:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024887680:0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.217772:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023774.217837:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023774.217843:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024887552:0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.217871:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023774.217901:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024887808:0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.217923:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023774.217966:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887680 00000100:00100000:1.0:1789023774.217973:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887680 00000100:00100000:1.0:1789023774.218020:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887808 00000100:00100000:1.0:1789023774.218024:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887808 00000100:00100000:1.0:1789023774.218061:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023774.218069:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024887680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.218115:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024887680:12345-0@lo:400:kworker.0 Request processed in 47us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023774.218122:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023774.218138:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023774.218144:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024887808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.218172:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024887808:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023774.218178:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789023774.218195:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887552 00000100:00100000:1.0:1789023774.218198:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887552 00000100:00100000:1.0:1789023774.218221:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789023774.218227:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:3313:x1875927024887552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.218254:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:3313:x1875927024887552:12345-0@lo:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023774.218260:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789023774.218284:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023774.218308:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f6c95180 x1875927024887808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023774.218321:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024887808:0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.218343:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024887552:0@lo:400:kworker.0 00010000:00080000:1.0:1789023774.218362:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f6c95f80 x1875927024887680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023774.218371:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024887680:0@lo:400:kworker.0 00000100:00100000:1.0:1789023774.281586:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789023759/real 1789023759] req@ffff8e64c18ddc00 x1875927024883712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023774 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023774.281614:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e64c18ddc00 x1875927024883712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023774 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023774.281633:0:3309:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789023759/real 1789023759] req@ffff8e64c18dce00 x1875927024883840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023774 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023774.281644:0:3309:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e64c18dce00 x1875927024883840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789023774 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789023774.281662:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65f78e7000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789023774.281687:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789023774.281691:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024883712:0@lo:8:kworker.0 00000100:00080000:1.0:1789023774.281697:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789023774.281702:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789023774.281705:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024883840:0@lo:8:kworker.0 00000100:00080000:2.0:1789023774.281768:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023774.281772:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789023774.281775:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e65f78e7000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789023774.281791:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1789023774.281796:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789023774.281817:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e65f78e7000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789023774.281850:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e64c18dea00 x1875927024887936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789023774.281874:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789023774.281877:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789023774.281879:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789023774.281882:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1789023774.281885:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789023774.281889:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e65e64e8000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:2.0:1789023774.281900:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e64c18dfb80 x1875927024888064/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789023774.281952:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024887936:0@lo:8:kworker.0 00000100:00100000:1.0:1789023774.282010:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023774.282056:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024888064:0@lo:8:kworker.0 00000100:00100000:1.0:1789023774.282077:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023774.282157:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024887936 00000100:00100000:2.0:1789023774.282172:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024887936 00000100:00100000:2.0:1789023774.282204:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888064 00000100:00100000:2.0:1789023774.282207:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888064 00000100:00100000:2.0:1789023774.282220:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023774.282227:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875927024887936:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789023774.282251:0:15023:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1789023774.282294:0:15023:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3418dbb 00002000:00100000:2.0:1789023774.282306:0:15023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e65c9b2f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789023774.282319:0:15023:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789023774.282322:0:15023:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789023774.282701:0:15023:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789023774.282723:0:15023:0:(import.c:65:import_set_state_nolock()) ffff8e65c9b28800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023774.282783:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875927024887936:12345-0@lo:8:kworker.0 Request processed in 555us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023774.282801:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023774.282818:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023774.282823:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875927024888064:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789023774.282833:0:15023:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1789023774.282840:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e64c18dea00 x1875927024887936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023774.282849:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789023774.282855:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00100000:2.0:1789023774.282857:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875927024888064:12345-0@lo:8:kworker.0 Request processed in 33us (780us total) trans 0 rc -19/-19 00000100:00080000:3.0:1789023774.282862:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00100000:2.0:1789023774.282863:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789023774.282866:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789023774.282868:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65f78e7000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789023774.282881:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789023774.282885:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024887936:0@lo:8:kworker.0 00000100:00080000:3.0:1789023774.282894:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789023774.282897:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789023774.282901:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024888064:0@lo:8:kworker.0 00000004:00080000:3.0:1789023774.282947:0:14363:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789023774.282949:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024888192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023774.282961:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875927024888320:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789023774.282981:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023774.282984:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023774.282997:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d8d1dd80 going to sleep for 11 seconds 00000004:00080000:3.0:1789023774.283009:0:14362:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789023774.283224:0:14362:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440353745553ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789023774.283275:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888192 00000100:00100000:3.0:1789023774.283280:0:15026:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888192 00000100:00100000:1.0:1789023774.283284:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888320 00000100:00100000:1.0:1789023774.283292:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888320 00000100:00100000:3.0:1789023774.283313:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789023774.283320:0:15026:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024888192:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023774.283323:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023774.283328:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14363:x1875927024888320:12345-0@lo:5:osp-pre-0-0.0 00002000:00000024:3.0:1789023774.283340:0:15026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023774.283373:0:15026:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875927024888192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023774.283379:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1789023774.283394:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789023774.283415:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65c84c2a00 x1875927024888192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789023774.283429:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024888192:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1789023774.285560:0:15024:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789023774.285570:0:15024:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789023774.285575:0:15024:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1789023774.296922:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.296933:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.296951:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.296955:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.296961:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.296977:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.296986:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.296993:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297010:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.297023:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.297028:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297050:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ec00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.297055:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297065:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297081:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297088:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418dc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297104:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.297106:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.297107:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.297523:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.297529:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297537:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.297541:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.297545:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297553:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297565:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297573:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297588:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023774.297938:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.297943:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297952:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.297954:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.297958:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297967:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297973:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.297980:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.298003:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789023774.298011:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023774.298016:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.298023:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.298026:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.298033:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300710:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300726:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b613e546/0xc3c1fcbfb3418dc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300747:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.300872:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300882:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.300887:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300908:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300933:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300941:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009db92b59/0xc3c1fcbfb3418dd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.300955:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.300957:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.300959:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.301640:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.301648:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301659:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.301664:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.301669:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301681:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301689:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301703:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301719:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.301730:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.301733:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301739:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.301742:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301750:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301967:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301975:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418dd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.301991:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.301992:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.301994:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.302444:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.302457:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302466:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.302470:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.302474:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302497:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302505:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302512:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302525:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.302533:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.302536:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302543:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ea00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.302546:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302553:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302568:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302575:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418dde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302588:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.302589:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.302591:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.302948:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.302954:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302962:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.302965:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.302969:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302979:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302987:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.302994:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303017:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.303025:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.303029:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303035:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fa00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.303038:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303058:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303070:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303078:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418de5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303090:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.303092:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.303093:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.303473:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.303498:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303507:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.303515:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.303519:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303528:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303537:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303544:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303558:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.303566:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.303569:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303576:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.303580:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303587:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303598:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303614:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418dec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303627:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.303629:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.303631:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.303974:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.303980:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.303988:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.303991:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.303995:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.304004:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.304012:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.304019:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.304032:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.304039:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023774.304639:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.309866:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.309879:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.309884:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.309895:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.309925:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.309934:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418df3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.309956:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.309958:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.309960:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.310566:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.310573:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310586:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.310590:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.310596:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310631:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310640:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310648:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310664:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.310675:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.310679:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310686:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.310689:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310697:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310708:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310716:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418dfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.310735:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.310737:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.310738:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.311111:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.311117:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311126:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.311129:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.311134:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311143:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311151:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311157:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311171:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.311180:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.311184:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311201:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.311205:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311212:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311221:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311228:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418e01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311239:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.311241:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.311243:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.311644:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.311650:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311658:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.311661:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.311666:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311675:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311689:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311696:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311708:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.311715:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.311719:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311727:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.311730:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311738:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311749:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311756:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418e08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.311768:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.311774:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.311776:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.312143:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.312148:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312156:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.312160:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.312163:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312171:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312179:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312186:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312198:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.312205:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.312208:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312214:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ee00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.312217:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312234:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312244:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312252:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418e0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312267:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.312268:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.312270:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.312689:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.312695:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312704:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.312707:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.312711:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312720:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312727:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312740:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312753:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.312760:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.312764:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312770:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.312773:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312780:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312791:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312798:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.312811:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.312812:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.312813:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.320544:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.320564:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.320581:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.320585:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.320591:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.320617:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.320627:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.320635:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.320656:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023774.321737:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.321746:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321757:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.321761:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.321766:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321776:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321790:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321798:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321815:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789023774.321830:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023774.321836:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321843:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.321847:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321856:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321872:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321879:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e1d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321895:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.321902:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.321909:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eaa00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.322688:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.322699:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.322712:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.322719:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.322733:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.322734:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.322736:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023774.323072:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.324356:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.324365:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324379:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.324383:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.324389:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324412:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324420:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324426:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324443:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.324453:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.324458:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324465:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.324469:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324494:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324508:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324515:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418e2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.324535:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.324537:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.324538:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.328612:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.328623:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328640:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.328644:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.328650:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328663:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328672:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328679:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328697:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.328710:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.328716:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328734:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.328738:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328746:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328761:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328768:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418e32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.328786:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.328787:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.328789:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.329758:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.329766:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.329776:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.329780:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.329784:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.329794:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.329812:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.329819:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.329837:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789023774.330248:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023774.330255:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023774.330283:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023774.330287:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023774.330295:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023774.330321:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023774.330329:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418e39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023774.330347:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023774.330349:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023774.330350:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.332140:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.332153:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.332864:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.332868:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.332874:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.332888:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.332898:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.332905:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333016:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.333029:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.333035:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333088:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ebc00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.333093:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333103:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333118:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333126:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f56b408/0xc3c1fcbfb3418e40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333143:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.333145:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.333146:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.333704:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.333712:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333721:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.333730:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.333735:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333744:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333752:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333758:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333774:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.333782:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.333786:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333793:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.333796:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333804:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333814:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333831:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063232608/0xc3c1fcbfb3418e47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.333844:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.333846:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.333847:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.336568:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.336579:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336593:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.336597:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.336604:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336617:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336626:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336632:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336651:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.336663:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.336674:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336681:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.336685:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336693:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336708:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336715:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba579c97/0xc3c1fcbfb3418e4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.336732:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.336734:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.336736:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.337452:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.337459:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337468:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.337471:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.337501:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337522:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337530:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337537:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337553:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.337563:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.337568:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337574:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eba00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.337577:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337585:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337597:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337604:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003921df04/0xc3c1fcbfb3418e55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.337625:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.337627:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.337629:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.338287:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.338293:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338302:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.338306:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.338312:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338322:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338330:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338337:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338355:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.338365:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.338370:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338388:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eac00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.338392:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338400:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338411:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338418:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418e5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338435:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.338437:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.338438:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.338865:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.338870:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338878:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.338881:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.338884:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338892:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.338907:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.339253:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.339391:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.339402:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.339407:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.339414:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.339417:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.339425:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.339438:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.339445:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418e63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.339462:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.339469:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.339471:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.340451:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.340459:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.340472:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.342463:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.342489:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.342731:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.342743:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.342751:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.342775:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023774.343368:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.343375:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343387:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.343390:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.343395:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343412:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343421:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343427:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343445:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789023774.343458:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789023774.343463:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343471:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.343506:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343516:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343532:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343540:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418e6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343563:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.343567:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343573:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eaa00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.343576:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343584:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343593:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343599:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418e71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.343612:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.343613:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.343615:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023774.343988:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023774.343994:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344002:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789023774.344005:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023774.344014:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344023:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344031:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344038:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344060:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023774.344067:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023774.344071:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344077:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eae00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023774.344080:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344087:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344098:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344115:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418e78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023774.344126:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.344128:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023774.344130:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789023774.344289:0:15024:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1789023774.344379:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14363:x1875927024888320:12345-0@lo:5:osp-pre-0-0.0 Request processed in 61047us (61390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023774.344388:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023774.344441:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875927024888320:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789023774.344457:0:14363:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1789023774.344520:0:14363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875927024888448:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789023774.344551:0:14363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023774.344582:0:14363:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06eca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789023774.344601:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888448 00000100:00100000:1.0:1789023774.344607:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888448 00000100:00100000:1.0:1789023774.344638:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023774.344646:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14363:x1875927024888448:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1789023774.344677:0:15022:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:2.0:1789023774.346283:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023774.365088:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14363:x1875927024888448:12345-0@lo:5:osp-pre-0-0.0 Request processed in 20434us (20528us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789023774.365101:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023774.366116:0:14363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14363:1875927024888448:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789023774.366133:0:14363:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:3.0:1789023774.372311:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1789023774.412657:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023775.433634:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023776.465271:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789023776.846747:0:15742:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789023776.846751:0:15742:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789023776.846909:0:15742:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8e64c1193000 00000020:01000004:3.0:1789023776.846923:0:15742:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789023776.846934:0:15742:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789023776.846955:0:15742:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e64c1124d40) 00000020:00000080:3.0:1789023776.846969:0:15742:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789023776.866410:0:15742:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789023776.866878:0:15742:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789023776.867798:0:15742:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789023776.868042:0:15742:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789023776.868246:0:15742:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789023776.868791:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 579: rc = 0 00100000:10000000:3.0:1789023776.868931:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1789023776.869069:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789023776.870911:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 428: rc = 0 00100000:10000000:3.0:1789023776.871168:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 428: rc = 0 00100000:10000000:3.0:1789023776.871413:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 428: rc = 0 00100000:10000000:3.0:1789023776.871821:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 428: rc = 0 00100000:10000000:3.0:1789023776.872332:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 428: rc = 0 00100000:10000000:3.0:1789023776.872875:0:15742:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 428: rc = 0 00000020:00000080:3.0:1789023776.874841:0:15742:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789023776.874854:0:15742:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789023776.874866:0:15742:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3c1fcbfb3418e86 00000020:01000004:3.0:1789023776.874875:0:15742:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789023776.874896:0:15742:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789023776.874899:0:15742:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789023776.874905:0:15742:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789023776.874924:0:15742:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789023776.874928:0:15742:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789023776.884438:0:15742:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789023776.884662:0:15742:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.148@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789023776.884666:0:15742:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789023776.884668:0:15742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789023776.884669:0:15742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023776.884671:0:15742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023776.884677:0:15742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023776.884679:0:15742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023776.884680:0:15742:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023776.884682:0:15742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023776.884683:0:15742:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789023776.884686:0:15742:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789023776.884688:0:15742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789023776.884689:0:15742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789023776.884690:0:15742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789023776.884691:0:15742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789023776.884692:0:15742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789023776.884693:0:15742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789023776.884694:0:15742:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789023776.884695:0:15742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789023776.884695:0:15742:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789023776.884721:0:15742:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789023776.884742:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888576:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789023776.884809:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.884921:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ece40 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.884969:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888576 00000100:00100000:2.0:1789023776.884976:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888576 00000100:00100000:2.0:1789023776.885086:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789023776.885096:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15742:x1875927024888576:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789023776.885137:0:14333:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789023776.885140:0:14333:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789023776.885144:0:14333:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789023776.896049:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15742:x1875927024888576:12345-0@lo:253:mount.lustre.0 Request processed in 10946us (11230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023776.896065:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789023776.896146:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888576:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789023776.896160:0:15742:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789023776.896164:0:15742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789023776.896166:0:15742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789023776.896167:0:15742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789023776.896169:0:15742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789023776.896170:0:15742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789023776.896171:0:15742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789023776.896173:0:15742:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789023776.896174:0:15742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789023776.896176:0:15742:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789023776.896196:0:15742:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e64c1193000 from lustre-OST0001 10000000:01000000:1.0:1789023776.896225:0:15742:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789023776.896228:0:15742:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789023776.896235:0:15742:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e65f00419c0 local copy 00010000:00010000:1.0:1789023776.896245:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023776.896457:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888704:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023776.896572:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.896706:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1600 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.896750:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888704 00000100:00100000:2.0:1789023776.896756:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888704 00000100:00100000:2.0:1789023776.896832:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789023776.896842:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15742:x1875927024888704:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789023776.897015:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15742:x1875927024888704:12345-0@lo:501:mount.lustre.0 Request processed in 174us (443us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789023776.897023:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789023776.897101:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888704:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789023776.897115:0:15742:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789023776.897278:0:15742:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789023776.897284:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.897294:0:15742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e707e000/0xc3c1fcbfb3418c33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418c3a expref: -99 pid: 14322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023776.897317:0:15742:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e64c1193000 10000000:01000000:3.0:1789023776.897322:0:15742:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789023776.897332:0:15742:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789023776.897335:0:15742:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789023776.897340:0:15742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789023776.897343:0:15742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789023776.897367:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3418e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.897376:0:15742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3418e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.897385:0:15742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3418e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023776.897399:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888832:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789023776.897432:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.897639:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ecf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023776.897856:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888832 00000100:00100000:1.0:1789023776.897861:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888832 00000100:00100000:1.0:1789023776.897887:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789023776.897895:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:15742:x1875927024888832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023776.897904:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023776.897917:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65ee3eba00/0xc3c1fcbfb3418e94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418e8d expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.897938:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65ee3eba00/0xc3c1fcbfb3418e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418e8d expref: 17 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.897960:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65ee3eba00/0xc3c1fcbfb3418e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418e8d expref: 17 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.897969:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65ee3eba00, rc 0) 00000100:00100000:1.0:1789023776.898055:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024888832:12345-0@lo:101:mount.lustre.0 Request processed in 161us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.898063:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789023776.898175:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888832:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789023776.898189:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3418e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418e94 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.898198:0:15742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3418e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418e94 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789023776.898949:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789023776.899944:0:15742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023776.900209:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789023776.900259:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789023776.900298:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789023776.900348:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789023776.900390:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789023776.900442:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789023776.900551:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789023776.900560:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789023776.900755:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789023776.900816:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.900898:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ece40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023776.900964:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024888960 00000100:00100000:0.0:1789023776.900972:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024888960 00000100:00100000:1.0:1789023776.901092:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789023776.901104:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024888960:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023776.901414:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024888960:12345-0@lo:501:mount.lustre.0 Request processed in 312us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.901422:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789023776.901540:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024888960:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789023776.901573:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889088:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789023776.901711:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.901774:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ece40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023776.901832:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889088 00000100:00100000:0.0:1789023776.901837:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889088 00000100:00100000:0.0:1789023776.901856:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789023776.901862:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024889088:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789023776.902157:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024889088:12345-0@lo:503:mount.lustre.0 Request processed in 294us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023776.902163:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789023776.902246:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889088:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789023776.902827:0:15742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789023776.902901:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789023776.902942:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.902967:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ece40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023776.903105:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889216 00000100:00100000:1.0:1789023776.903111:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889216 00000100:00100000:1.0:1789023776.903136:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789023776.903144:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024889216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023776.903346:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024889216:12345-0@lo:502:mount.lustre.0 Request processed in 202us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.903354:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789023776.903513:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789023776.903849:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789023776.903894:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789023776.903922:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789023776.903963:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789023776.904004:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789023776.904052:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789023776.904108:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789023776.904149:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789023776.904200:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789023776.904230:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889344:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789023776.904269:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.904364:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ece40 going to sleep for 11 seconds 00000100:00100000:1.0:1789023776.904427:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889344 00000100:00100000:1.0:1789023776.904433:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889344 00000100:00100000:1.0:1789023776.904468:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789023776.904688:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024889344:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023776.904948:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024889344:12345-0@lo:502:mount.lustre.0 Request processed in 472us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.904965:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789023776.905136:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889344:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789023776.905212:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789023776.905223:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1789023776.911538:0:15743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789023776.911551:0:15743:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1789023776.911557:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.911559:0:15743:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789023776.911569:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789023776.911680:0:15743:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e65d27219c0) 00000020:00000080:1.0:1789023776.911704:0:15743:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789023776.911713:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789023776.911794:0:15743:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e64c1193000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789023776.911802:0:15743:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789023776.911809:0:15743:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc3c1fcbfb3418ea2 00010000:00010000:1.0:1789023776.915759:0:15743:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1789023776.916248:0:15743:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789023776.918168:0:15743:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789023776.919698:0:15743:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789023776.919710:0:15743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023776.919716:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.919718:0:15743:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789023776.919721:0:15743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023776.919725:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.919726:0:15743:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789023776.919728:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789023776.919730:0:15743:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789023776.919732:0:15743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023776.919734:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.919735:0:15743:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789023776.919738:0:15743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023776.919740:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.919741:0:15743:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789023776.919744:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789023776.919790:0:15743:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023776.919800:0:15743:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.919801:0:15743:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789023776.919804:0:15743:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789023776.920084:0:15742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789023776.920112:0:15742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789023776.920126:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3418e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418e94 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.920139:0:15742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713de00/0xc3c1fcbfb3418e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418e94 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023776.920148:0:15742:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e64c1193000 from 1 10000000:01000000:3.0:1789023776.920150:0:15742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789023776.920185:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.920193:0:15742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.920203:0:15742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023776.920226:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889472:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789023776.920292:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.920337:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023776.920445:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889472 00000100:00100000:1.0:1789023776.920452:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889472 00000100:00100000:1.0:1789023776.920532:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789023776.920542:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+17:15742:x1875927024889472:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023776.920554:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023776.920565:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418ea9 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.920707:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.920719:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.920726:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65ee3eb600, rc 0) 00000100:00100000:1.0:1789023776.920769:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889472:12345-0@lo:101:mount.lustre.0 Request processed in 229us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.920775:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789023776.920848:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889472:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789023776.920862:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.920885:0:15742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789023776.921374:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789023776.921699:0:15742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789023776.921960:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789023776.922011:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789023776.922112:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789023776.922121:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789023776.922183:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889600:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789023776.922232:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.922278:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06ec0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.922513:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889600 00000100:00100000:2.0:1789023776.922520:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889600 00000100:00100000:2.0:1789023776.922562:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789023776.922571:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889600:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789023776.922781:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889600:12345-0@lo:501:mount.lustre.0 Request processed in 211us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023776.922788:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789023776.922954:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889600:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023776.922990:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889728:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789023776.923036:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.923058:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.923149:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889728 00000100:00100000:2.0:1789023776.923153:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889728 00000100:00100000:2.0:1789023776.923183:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789023776.923189:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889728:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789023776.923321:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889728:12345-0@lo:503:mount.lustre.0 Request processed in 131us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023776.923328:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789023776.923408:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889728:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789023776.924077:0:15742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023776.924139:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889856:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023776.924187:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.924269:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.928352:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889856 00000100:00100000:2.0:1789023776.928368:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889856 00000100:00100000:2.0:1789023776.928428:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789023776.928439:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789023776.928710:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889856:12345-0@lo:502:mount.lustre.0 Request processed in 272us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023776.928718:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789023776.928888:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889856:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789023776.929171:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1789023776.929222:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1789023776.929267:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1789023776.929303:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1789023776.929338:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1789023776.929387:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1789023776.929419:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1789023776.929448:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1789023776.929508:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889984:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023776.929556:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.929595:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.929770:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024889984 00000100:00100000:2.0:1789023776.929777:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024889984 00000100:00100000:2.0:1789023776.929824:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789023776.929833:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f78fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789023776.929996:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f78fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024889984:12345-0@lo:502:mount.lustre.0 Request processed in 164us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023776.930003:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789023776.930160:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024889984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789023776.930264:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789023776.930275:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789023776.932228:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023776.932242:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.932244:0:15747:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789023776.932255:0:15747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e64c1193000 00000020:00000080:1.0:1789023776.932258:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789023776.932266:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023776.932268:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.932270:0:15747:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789023776.932272:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023776.932275:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.932276:0:15747:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789023776.932279:0:15747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e64c1193000 00000020:00000080:1.0:1789023776.932287:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789023776.932349:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023776.932352:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.932354:0:15747:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789023776.932357:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789023776.932360:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.932361:0:15747:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789023776.932365:0:15747:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e64c1193000 00000020:00000080:1.0:1789023776.932367:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789023776.932407:0:15747:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789023776.932411:0:15747:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789023776.932413:0:15747:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789023776.932416:0:15747:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789023776.934039:0:15742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789023776.934071:0:15742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789023776.934089:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.934104:0:15742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789023776.934152:0:15742:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789023776.934155:0:15742:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e64c1193000 10000000:01000000:1.0:1789023776.934159:0:15742:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e64c1193000 10000000:01000000:1.0:1789023776.934162:0:15742:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789023776.934167:0:15742:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8e64c1193000 from 1 10000000:01000000:1.0:1789023776.934170:0:15742:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789023776.934204:0:15742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65ee3ea400/0xc3c1fcbfb3418eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.934213:0:15742:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65ee3ea400/0xc3c1fcbfb3418eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.934238:0:15742:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65ee3ea400/0xc3c1fcbfb3418eb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023776.934262:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890112:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789023776.934324:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.934362:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1180 going to sleep for 11 seconds 00000100:00100000:3.0:1789023776.934456:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024890112 00000100:00100000:3.0:1789023776.934465:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024890112 00000100:00100000:3.0:1789023776.934528:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789023776.934537:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024890112:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789023776.934552:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023776.934564:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713ca00/0xc3c1fcbfb3418ebe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418eb7 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.934598:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713ca00/0xc3c1fcbfb3418ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418eb7 expref: 19 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.934608:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713ca00/0xc3c1fcbfb3418ebe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418eb7 expref: 19 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023776.934616:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713ca00, rc 0) 00000100:00100000:3.0:1789023776.934664:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:15742:x1875927024890112:12345-0@lo:101:mount.lustre.0 Request processed in 128us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023776.934678:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789023776.936069:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890112:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789023776.936091:0:15742:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65ee3ea400/0xc3c1fcbfb3418eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ebe expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023776.936102:0:15742:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65ee3ea400/0xc3c1fcbfb3418eb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418ebe expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789023776.938374:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1789023776.954124:0:15742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023776.954453:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1789023776.954580:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1789023776.956109:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1789023776.956196:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1789023776.956238:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1789023776.956290:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1789023776.956327:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1789023776.956361:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1789023776.956411:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1789023776.956449:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1789023776.956505:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1789023776.956556:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1789023776.957725:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1789023776.957789:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1789023776.957879:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1789023776.958669:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1789023776.958719:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1789023776.958780:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1789023776.958818:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1789023776.958851:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1789023776.960014:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1789023776.960111:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1789023776.960149:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1789023776.960239:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1789023776.960277:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1789023776.960311:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1789023776.960361:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1789023776.960400:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1789023776.960434:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1789023776.960502:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1789023776.960559:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1789023776.962082:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1789023776.962159:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1789023776.962235:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1789023776.962275:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1789023776.962325:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1789023776.962362:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1789023776.962452:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1789023776.962461:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1789023776.965351:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023776.965418:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.965464:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1180 going to sleep for 11 seconds 00000100:00100000:0.0:1789023776.966246:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024890240 00000100:00100000:0.0:1789023776.966255:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024890240 00000100:00100000:0.0:1789023776.966299:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789023776.966309:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:15742:x1875927024890240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023776.966706:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890240:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789023776.966748:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890368:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789023776.967874:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.968121:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65de1b1180 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.968190:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024890368 00000100:00100000:2.0:1789023776.968198:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024890368 00000100:00100000:2.0:1789023776.968246:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789023776.968256:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+20:15742:x1875927024890368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789023776.968444:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+20:15742:x1875927024890368:12345-0@lo:503:mount.lustre.0 Request processed in 190us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023776.968452:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789023776.969348:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890368:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789023776.970141:0:15742:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789023776.970233:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023776.970304:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.970347:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024890496 00000100:00100000:1.0:1789023776.970352:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024890496 00000100:00100000:1.0:1789023776.970386:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789023776.970392:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+20:15742:x1875927024890496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789023776.971755:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+20:15742:x1875927024890496:12345-0@lo:502:mount.lustre.0 Request processed in 1357us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.971765:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789023776.971824:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208000 going to sleep for 11 seconds 00000100:00100000:1.0:1789023776.971847:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789023776.972873:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:15742:x1875927024890240:12345-0@lo:501:mount.lustre.0 Request processed in 6561us (7450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023776.972884:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000040:00080000:1.0:1789023776.973259:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1789023776.973326:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1789023776.973363:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1789023776.973412:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1789023776.973452:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1789023776.973542:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1789023776.973580:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1789023776.975400:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1789023776.975500:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1789023776.975545:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1789023776.976466:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1789023776.977040:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1789023776.977095:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1789023776.977133:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1789023776.977186:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1789023776.977226:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1789023776.977257:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1789023776.977295:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1789023776.977325:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1789023776.977352:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1789023776.977391:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1789023776.977443:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1789023776.978674:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1789023776.978785:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1789023776.978824:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1789023776.978855:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1789023776.979049:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1789023776.979090:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1789023776.979123:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1789023776.979169:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1789023776.979203:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1789023776.979236:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1789023776.979267:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1789023776.979339:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1789023776.979381:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1789023776.979426:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1789023776.979463:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789023776.979881:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789023776.980035:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789023776.980075:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789023776.980128:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789023776.980202:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023776.980283:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29ae900 going to sleep for 11 seconds 00000100:00100000:2.0:1789023776.980325:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024890624 00000100:00100000:2.0:1789023776.980333:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024890624 00000100:00100000:2.0:1789023776.980422:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789023776.980431:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:15742:x1875927024890624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789023776.980869:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:15742:x1875927024890624:12345-0@lo:502:mount.lustre.0 Request processed in 439us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023776.980878:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789023776.981113:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024890624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789023776.981192:0:15742:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789023776.981202:0:15742:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789023776.982438:0:15752:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789023776.982469:0:15752:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e64c2314d40) 00000020:00000080:1.0:1789023776.982576:0:15752:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789023776.982734:0:15752:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e64c1193000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789023776.982739:0:15752:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e64c1193000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789023776.982741:0:15752:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8e64c1193000 3 00010000:00080000:1.0:1789023776.982771:0:15752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e65fcba5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.148@tcp at head 00010000:00010000:0.0:1789023776.985391:0:15752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1789023776.985991:0:15752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789023776.986042:0:15752:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789023776.986056:0:15752:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc3c1fcbfb3418ecc 00000100:00080000:0.0:1789023776.986068:0:15752:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789023776.986080:0:15752:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e65fcba5000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:0.0:1789023776.986115:0:15752:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f7981180 x1875927024890752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789023776.986145:0:15752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789023776.986319:0:15606:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789023776.986333:0:15606:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789023776.986336:0:15606:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789023776.986340:0:15606:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 440 00000100:00080000:1.0:1789023776.986345:0:15606:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789023776.986350:0:15606:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e65e64e8000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789023776.986364:0:15606:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f6c96d80 x1875927024891008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789023776.986417:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024891136:0@lo:400:kworker.0 00000100:00100000:1.0:1789023776.986500:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.986539:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023776.986545:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024890880:0@lo:400:kworker.0 00000100:00100000:1.0:1789023776.986570:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.986609:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024891264:0@lo:400:kworker.0 00000100:00100000:1.0:1789023776.986633:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023776.986665:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891136 00000100:00100000:1.0:1789023776.986672:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891136 00000100:00100000:1.0:1789023776.986708:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891264 00000100:00100000:1.0:1789023776.986712:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891264 00000100:00100000:1.0:1789023776.986737:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023776.986746:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024891136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023776.986794:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024891136:12345-0@lo:400:kworker.0 Request processed in 49us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.986800:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023776.986815:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023776.986821:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024891264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023776.986851:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024891264:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.986865:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023776.986885:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024890880 00000100:00100000:1.0:1789023776.986888:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024890880 00000100:00100000:1.0:1789023776.986930:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023776.986937:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875927024890880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023776.986966:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875927024890880:12345-0@lo:400:kworker.0 Request processed in 30us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.986971:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789023776.986992:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023776.986996:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023776.987021:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f6c97b80 x1875927024891264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023776.987045:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024891264:0@lo:400:kworker.0 00000100:00100000:1.0:1789023776.987072:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024890880:0@lo:400:kworker.0 00010000:00080000:1.0:1789023776.987082:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f6c94380 x1875927024891136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023792 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023776.987090:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024891136:0@lo:400:kworker.0 00000100:00100000:3.0:1789023776.987295:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875927024890752:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789023776.987330:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023776.987368:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024891008:0@lo:8:kworker.0 00000100:00100000:3.0:1789023776.987388:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1789023776.987707:0:15752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789023776.987820:0:15742:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789023776.987859:0:15742:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789023776.987872:0:15742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65ee3ea400/0xc3c1fcbfb3418eb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ebe expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023776.987882:0:15742:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65ee3ea400/0xc3c1fcbfb3418eb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ebe expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789023776.988127:0:15742:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789023776.988130:0:15742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789023776.988131:0:15742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023776.988133:0:15742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023776.988134:0:15742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023776.988135:0:15742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023776.988137:0:15742:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023776.988138:0:15742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023776.988139:0:15742:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789023776.988143:0:15742:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789023776.988146:0:15742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789023776.988147:0:15742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789023776.988148:0:15742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023776.988149:0:15742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023776.988150:0:15742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023776.988151:0:15742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023776.988152:0:15742:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023776.988153:0:15742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023776.988154:0:15742:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789023776.988196:0:15742:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789023776.988209:0:15742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7980e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024891392:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789023776.988250:0:15742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023776.988278:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891392 00000100:00100000:0.0:1789023776.988284:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891392 00000100:00100000:0.0:1789023776.988313:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789023776.988320:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:15742:x1875927024891392:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789023776.988343:0:14334:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789023776.988363:0:14334:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789023776.989036:0:15742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29aef00 going to sleep for 11 seconds 00000100:00100000:1.0:1789023776.989116:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891008 00000100:00100000:1.0:1789023776.989122:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891008 00000100:00100000:1.0:1789023776.989156:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023776.989162:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875927024891008:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789023776.989223:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1875927024891008:12345-0@lo:8:kworker.0 Request processed in 60us (1833us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789023776.989231:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789023776.989283:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789023776.989298:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789023776.989302:0:3309:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789023776.989306:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024891008:0@lo:8:kworker.0 00000100:00100000:1.0:1789023776.989330:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024890752 00000100:00100000:1.0:1789023776.989334:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024890752 00000100:00100000:1.0:1789023776.989355:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023776.989360:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1875927024890752:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789023776.989375:0:14342:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1789023776.989405:0:14342:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc3c1fcbfb3418ed3 00000004:00100000:1.0:1789023776.989418:0:14342:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789023776.989446:0:14342:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023776.989511:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875927024890752:12345-0@lo:38:llog_process_th.0 Request processed in 149us (2179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023776.989518:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789023776.989576:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e65f7981180 x1875927024890752/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789023786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023776.989655:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789023776.989660:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789023776.989668:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789023776.989672:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789023776.989674:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789023776.989680:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1875927024890752:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1789023777.025791:0:14334:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789023777.025808:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1789023777.026526:0:14356:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789023777.026533:0:14356:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789023777.026557:0:14356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023777.026575:0:14356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023777.026593:0:14356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023777.026634:0:14356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023777.026648:0:14356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 19 pid: 14333 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023777.026662:0:14356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875927024891520:0@lo:104: 00000100:00100000:3.0:1789023777.026722:0:14356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023777.026759:0:14356:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d0868e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789023777.027032:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891520 00000100:00100000:2.0:1789023777.027041:0:14324:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891520 00000100:00100000:2.0:1789023777.027088:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023777.027097:0:14324:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14356:x1875927024891520:12345-0@lo:104: 00010000:00010000:2.0:1789023777.027111:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027169:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789023777.027187:0:14324:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:96e4333f-cc82-4def-9373-4ed84d9f7775+3:14356:x1875927024891520:12345-0@lo:104: Request processed in 91us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023777.027194:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789023777.027218:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023777.027223:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027230:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f800 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:2.0:1789023777.027234:0:14328:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027242:0:14328:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789023777.027249:0:14328:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789023777.027255:0:14328:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789023777.027284:0:14328:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027291:0:14328:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789023777.027310:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027317:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e707f800/0xc3c1fcbfb3418dad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418db4 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027332:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023777.027334:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023777.027336:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023777.027363:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96e4333f-cc82-4def-9373-4ed84d9f7775:3311:1875927024891648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023777.027396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023777.027431:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891648 00000100:00100000:2.0:1789023777.027435:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891648 00010000:00010000:2.0:1789023777.027453:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 20 pid: 14333 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023777.027496:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023777.027504:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+20:3311:x1875927024891648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789023777.027514:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023777.027518:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 20 pid: 14333 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027530:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 20 pid: 14333 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027546:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027555:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789023777.027567:0:14327:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005420521s 00010000:00010000:2.0:1789023777.027572:0:14327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027579:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027598:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027616:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027622:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023777.027626:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027633:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027642:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027651:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023777.027681:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+20:3311:x1875927024891648:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023777.027689:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789023777.027730:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96e4333f-cc82-4def-9373-4ed84d9f7775:3311:1875927024891648:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789023777.027755:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418db4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3418dad expref: 19 pid: 14333 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023777.027765:0:14356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14356:1875927024891520:0@lo:104: 00010000:00010000:2.0:1789023777.027776:0:14356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027784:0:14356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027800:0:14356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023777.027806:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65e713d800/0xc3c1fcbfb3418eda lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023777.036970:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+18:15742:x1875927024891392:12345-0@lo:253:mount.lustre.0 Request processed in 48640us (48709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023777.036987:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789023777.037158:0:15742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7980e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:96e4333f-cc82-4def-9373-4ed84d9f7775:15742:1875927024891392:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789023777.037174:0:15742:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789023777.037178:0:15742:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789023777.037180:0:15742:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789023777.037181:0:15742:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789023777.037182:0:15742:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789023777.037183:0:15742:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789023777.037185:0:15742:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789023777.037186:0:15742:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789023777.037188:0:15742:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789023777.037190:0:15742:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789023777.037207:0:15742:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789023777.045460:0:15742:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789023777.045653:0:15742:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789023777.045816:0:15742:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789023777.046050:0:15742:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789023777.046198:0:15742:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789023777.046612:0:15742:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789023777.047548:0:15742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1789023777.112373:0:15742:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789023777.112382:0:15742:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789023777.112414:0:15742:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789023777.112794:0:15742:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789023777.112812:0:15742:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789023777.112841:0:15742:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789023777.481989:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789023778.377669:0:14337:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789023778.377676:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8e65e74a3000 from 8 10000000:01000000:2.0:1789023778.377679:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789023778.377714:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06400/0xc3c1fcbfb3418ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023778.377723:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06400/0xc3c1fcbfb3418ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023778.377732:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06400/0xc3c1fcbfb3418ee1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023778.377751:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024891776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789023778.377802:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023778.377849:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891776 00000100:00100000:2.0:1789023778.377855:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789023778.377857:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891776 00000100:00100000:0.0:1789023778.377916:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789023778.377926:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:14337:x1875927024891776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023778.377939:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023778.377954:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04800/0xc3c1fcbfb3418ee8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb3418ee1 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023778.377985:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04800/0xc3c1fcbfb3418ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ee1 expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023778.377997:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04800/0xc3c1fcbfb3418ee8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ee1 expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023778.378007:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04800, rc 0) 00000100:00100000:0.0:1789023778.378065:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:14337:x1875927024891776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023778.378072:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789023778.378120:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024891776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023778.378135:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06400/0xc3c1fcbfb3418ee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ee8 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023778.378152:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06400/0xc3c1fcbfb3418ee1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3418ee8 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023778.378198:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024891904:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789023778.378234:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023778.378264:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65f6af2780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023778.378319:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024891904 00000100:00100000:3.0:1789023778.378324:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024891904 00000100:00100000:3.0:1789023778.378354:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789023778.378362:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:14337:x1875927024891904:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789023778.378383:0:14334:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789023778.378398:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789023778.378402:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789023778.378504:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:14337:x1875927024891904:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023778.378510:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789023778.378541:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024891904:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789023778.378646:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789023778.378653:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06400/0xc3c1fcbfb3418ee1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ee8 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023778.378659:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65f6d06400/0xc3c1fcbfb3418ee1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3418ee8 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023778.506382:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023779.358498:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024892032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023779.358567:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023779.365228:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892032 00000100:00100000:3.0:1789023779.365242:0:15026:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892032 00000100:00100000:3.0:1789023779.365299:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789023779.365309:0:15026:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875927024892032:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789023779.365326:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789023779.365340:0:15026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789023779.365420:0:15026:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875927024892032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (6853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023779.365427:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023779.365466:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024892032:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1789023779.449326:0:6722:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1789023779.449373:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789023779.530000:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023780.555676:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789023781.067135:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789023781.577671:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023782.410538:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1789023782.410545:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789023782.410549:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789023782.410553:0:36:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789023782.410625:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024892160:0@lo:400:kworker.0 00000100:00100000:3.0:1789023782.410686:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023782.410897:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892160 00000100:00100000:0.0:1789023782.410906:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892160 00000100:00100000:0.0:1789023782.410955:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789023782.411016:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:3312:x1875927024892160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023782.411240:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:3312:x1875927024892160:12345-0@lo:400:kworker.0 Request processed in 276us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023782.411248:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789023782.411306:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024892160:0@lo:400:kworker.0 00000100:00080000:1.0:1789023782.411501:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e65e64e8000 using connection 192.168.203.148@tcp/0@lo 00000100:00100000:1.0:1789023782.411529:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e65f6c97b80 x1875927024892416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789023782.411710:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024892800:0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.411742:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023782.411765:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789023782.411771:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024892672:0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.411790:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023782.411812:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024892288:0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.411881:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023782.411901:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023782.411906:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024892544:0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.411926:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023782.411949:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892800 00000100:00100000:1.0:1789023782.411954:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892800 00000100:00100000:1.0:1789023782.411985:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892672 00000100:00100000:1.0:1789023782.411998:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892672 00000100:00100000:1.0:1789023782.412011:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892544 00000100:00100000:1.0:1789023782.412013:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892544 00000100:00100000:1.0:1789023782.412038:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023782.412044:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024892800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.412082:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024892800:12345-0@lo:400:kworker.0 Request processed in 39us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023782.412088:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789023782.412101:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023782.412107:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024892672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.412130:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875927024892672:12345-0@lo:400:kworker.0 Request processed in 24us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023782.412136:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023782.412145:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023782.412150:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024892544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.412175:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875927024892544:12345-0@lo:400:kworker.0 Request processed in 24us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023782.412181:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789023782.412197:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892288 00000100:00100000:1.0:1789023782.412200:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892288 00000100:00100000:1.0:1789023782.412222:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023782.412227:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024892288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.412255:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024892288:12345-0@lo:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023782.412260:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789023782.412277:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789023782.412280:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789023782.412299:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c96d80 x1875927024892544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023782.412323:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875927024892544:0@lo:400:kworker.0 00000100:00100000:1.0:1789023782.412333:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789023782.412344:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024892288:0@lo:400:kworker.0 00010000:00080000:1.0:1789023782.412364:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdea00 x1875927024892672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023782.412372:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1875927024892672:0@lo:400:kworker.0 00010000:00080000:1.0:1789023782.412380:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65ffcdfb80 x1875927024892800/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789023798 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789023782.412388:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024892800:0@lo:400:kworker.0 00000100:00100000:0.0:1789023782.412745:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024892416:0@lo:8:kworker.0 00000100:00100000:0.0:1789023782.412777:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023782.412923:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892416 00000100:00100000:2.0:1789023782.412928:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892416 00000100:00100000:2.0:1789023782.412952:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789023782.412958:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1875927024892416:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789023782.412983:0:15023:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1789023782.413023:0:15023:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc3c1fcbfb3418eef 00002000:00100000:2.0:1789023782.413036:0:15023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e65c9b2b800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789023782.413040:0:15023:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789023782.413043:0:15023:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789023782.413343:0:15023:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789023782.413368:0:15023:0:(import.c:65:import_set_state_nolock()) ffff8e65c9b2c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023782.413413:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875927024892416:12345-0@lo:8:kworker.0 Request processed in 454us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023782.413420:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789023782.413524:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e65f6c97b80 x1875927024892416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789023807 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789023782.413538:0:3309:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789023782.413545:0:3309:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789023782.413550:0:3309:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789023782.413552:0:3309:0:(import.c:65:import_set_state_nolock()) ffff8e65e64e8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789023782.413676:0:14365:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1789023782.413692:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875927024893056:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789023782.413722:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023782.413751:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d274a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023782.414018:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024892928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023782.414048:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023782.414091:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893056 00000100:00100000:1.0:1789023782.414096:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893056 00000100:00100000:1.0:1789023782.414130:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023782.414137:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14365:x1875927024893056:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789023782.414647:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789023782.414656:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1875927024892416:0@lo:8:kworker.0 00000100:00100000:2.0:1789023782.415126:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024892928 00000100:00100000:2.0:1789023782.415132:0:15026:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024892928 00000100:00100000:2.0:1789023782.415166:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789023782.415174:0:15026:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024892928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023782.415200:0:15026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023782.415262:0:15026:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024892928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023782.415269:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789023782.415340:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e64c18ddf80 x1875927024892928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789023798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789023782.415357:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024892928:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789023782.415527:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789023782.416057:0:14364:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789023782.418112:0:14364:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448488631931ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789023782.432070:0:15022:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789023782.432083:0:15022:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789023782.432089:0:15022:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1789023782.457381:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.457392:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.457407:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.457416:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.457422:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.457439:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.457449:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.457457:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.457499:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023782.457515:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023782.457520:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.457528:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eaa00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023782.457532:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.457542:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.458774:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.458800:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5fae2cd/0xc3c1fcbfb3418ef6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.458825:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.458827:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.458829:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.459418:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.459425:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.459436:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.459440:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.459446:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.459458:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.459467:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.459475:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.459514:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.460626:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.460635:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.460646:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eae00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.460651:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.460661:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.460683:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.460690:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007efc4f39/0xc3c1fcbfb3418efd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.460711:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.460723:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.460725:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.461397:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.461409:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.461421:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.461426:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.461431:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.461443:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.461451:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.461459:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.461947:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023782.462379:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.462386:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.462397:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.462401:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.462406:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.462416:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.462430:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.462436:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.465854:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023782.465867:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.465882:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.465888:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.465899:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.465919:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.465928:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad185b13/0xc3c1fcbfb3418f04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.465995:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.466000:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.466007:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.466010:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.466030:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.466041:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.466048:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.466050:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.466051:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.469305:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789023782.469320:0:15022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7eb7a7/0xc3c1fcbfb3418f0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789023782.470327:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.470336:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.470351:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.470356:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.470362:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471304:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471317:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471338:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471359:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789023782.471721:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789023782.471728:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471738:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023782.471743:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471753:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471769:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471777:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e43fc2d2/0xc3c1fcbfb3418f12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.471795:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.471797:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.471798:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.472665:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.473920:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.473940:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.473956:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.473961:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.473967:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.474000:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.474011:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.474018:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.474043:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.474243:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.474252:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.474263:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eac00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.474268:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.474278:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.474295:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.474303:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059523d0b/0xc3c1fcbfb3418f19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.474335:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.474337:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.474339:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789023782.475184:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789023782.475449:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.475457:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.475469:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.475473:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.475495:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.475508:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.475524:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.475531:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.475555:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.475582:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.475590:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.475599:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ebc00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.475604:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.475612:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.475627:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.475634:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f56b408/0xc3c1fcbfb3418f20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.475653:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.475654:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.475656:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.477979:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.477999:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.478016:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.478020:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.478026:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.478038:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.478048:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.478055:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.480294:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789023782.480644:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023782.480653:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.480666:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023782.480670:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.480694:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.480716:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.480723:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009ce9d115/0xc3c1fcbfb3418f27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.480746:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023782.480748:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023782.480749:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.482822:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.482833:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.482847:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.482851:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.482857:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.482870:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.482879:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.482887:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.482907:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023782.483388:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.483395:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483404:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.483414:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.483418:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483428:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483437:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483443:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483462:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789023782.483851:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.483857:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483867:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.483870:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.483875:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483890:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483898:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483910:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.483917:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789023782.484268:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789023782.484278:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789023782.484291:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.484302:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484305:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.484313:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484316:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.484323:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.484332:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484333:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484356:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484364:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484366:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484387:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000750fa13c/0xc3c1fcbfb3418f2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484388:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484412:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789023782.484420:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789023782.484425:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484432:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.484436:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484443:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484453:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484468:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7c062ea/0xc3c1fcbfb3418f35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484501:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023782.484504:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484511:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ebe00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.484515:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484522:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484533:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484541:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c69f0b9b/0xc3c1fcbfb3418f3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484556:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.484559:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484576:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3eb800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.484586:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484594:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484605:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484612:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004144a23c/0xc3c1fcbfb3418f43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.484628:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.484631:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.484634:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023782.484752:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.484880:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.484886:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484900:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.484903:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.484907:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484915:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484922:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484929:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.484951:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.485245:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.485250:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.485258:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65ee3ea600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.485261:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.485274:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.485286:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.485300:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fca94fcf/0xc3c1fcbfb3418f4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.485316:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.485318:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.485319:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.486175:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.486184:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486196:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.486199:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.486390:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486404:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486424:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486431:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486456:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023782.486909:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.486916:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486926:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.486928:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.486933:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486941:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.486949:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.487035:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.487061:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789023782.487510:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023782.487518:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487528:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.487533:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487544:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487562:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487641:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071d25303/0xc3c1fcbfb3418f51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487668:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.487673:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487687:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ee00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.487691:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487701:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789023782.487712:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789023782.487714:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.487723:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487728:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a6efaca/0xc3c1fcbfb3418f58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.487741:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.487746:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023782.487750:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.487751:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.487753:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.487757:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.487766:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.487774:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.487781:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.487802:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789023782.488089:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023782.488095:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.488103:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023782.488106:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.488115:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.488128:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023782.488148:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d51302a1/0xc3c1fcbfb3418f5f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.488151:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023782.488166:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023782.488168:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023782.488169:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.488638:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.488644:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.488654:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.488663:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.488668:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.488677:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.488686:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.488693:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.488709:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.489096:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.489104:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.489114:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fc00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.489118:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.489140:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.489153:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.489161:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b79d0094/0xc3c1fcbfb3418f66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.489181:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.489183:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.489185:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.491654:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.491667:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.491683:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.491688:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.491695:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.492611:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.492623:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.492638:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.492661:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023782.493611:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.493620:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.493634:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.493639:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.493645:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.493658:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.493668:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.493677:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.494336:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789023782.494738:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023782.494748:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494760:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e600 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.494765:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494776:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494796:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494816:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000799cfe41/0xc3c1fcbfb3418f6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494923:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.494928:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494937:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.494941:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494950:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494961:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494968:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d890d43d/0xc3c1fcbfb3418f74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.494982:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.494984:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.494985:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.495335:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.495343:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.495360:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.495364:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.495370:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.495380:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.495388:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.495394:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.495421:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023782.496265:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.496273:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496285:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.496290:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.496296:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496306:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496326:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496334:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496344:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789023782.496671:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789023782.496679:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496695:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.496700:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496709:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496725:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496732:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077bb9ada/0xc3c1fcbfb3418f7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496756:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.496760:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496768:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707fa00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.496771:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496779:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496790:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496804:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019fb0bcb/0xc3c1fcbfb3418f82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496821:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.496823:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789023782.496824:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.496828:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789023782.496832:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496841:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.496844:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.496848:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496857:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496865:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496872:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.496893:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.496949:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.496954:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496962:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ea00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.496966:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496975:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.496986:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.497002:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6d8bc06/0xc3c1fcbfb3418f89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.497017:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.497019:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.497021:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023782.497683:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.497840:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.497849:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.497862:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.497866:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.497872:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.497883:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.497891:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.497897:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.497920:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.497970:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.497976:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.497984:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.497996:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.498005:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.498018:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.498026:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026ed0910/0xc3c1fcbfb3418f90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.498043:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.498045:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.498047:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.498805:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.498813:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.498824:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.498834:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.498840:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.498851:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.498859:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.498866:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.498884:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789023782.499936:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.499944:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.499968:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.499972:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.499978:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.499999:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500009:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500023:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500042:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789023782.500539:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.500544:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500552:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.500555:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.500559:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500566:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500574:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500582:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.500591:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789023782.500671:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789023782.500681:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500691:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023782.500697:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500708:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500736:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500746:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009db92b59/0xc3c1fcbfb3418f97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500772:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789023782.500777:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500784:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707f200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023782.500787:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500796:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500808:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500815:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b613e546/0xc3c1fcbfb3418f9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500829:0:14328:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023782.500845:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500860:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707ec00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023782.500864:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500874:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500885:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500894:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a87f6ea/0xc3c1fcbfb3418fa5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023782.500914:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023782.500916:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023782.500918:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.501034:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.501040:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501053:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.501056:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.501060:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501069:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501077:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501085:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501105:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.501245:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.501251:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.501259:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66000 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.501263:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.501283:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.501295:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.501303:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9ccfd07/0xc3c1fcbfb3418fac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.501317:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.501319:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.501320:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789023782.501893:0:15022:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789023782.501899:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501909:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=448s v=(0 0) 00010000:00010000:1.0:1789023782.501912:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023782.501916:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501924:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501943:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.501949:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023782.502039:0:15022:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789023782.502076:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789023782.502082:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.502089:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67e00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023782.502093:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.502100:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.502112:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.502131:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089285b0d/0xc3c1fcbfb3418fb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023782.502148:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.502150:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789023782.502152:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789023782.502384:0:15022:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:1.0:1789023782.502502:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14365:x1875927024893056:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88337us (88751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023782.502512:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023782.502568:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18ded80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875927024893056:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789023782.502583:0:14365:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1789023782.502623:0:14365:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875927024893184:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789023782.502654:0:14365:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023782.502690:0:14365:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65ffc720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023782.502706:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893184 00000100:00100000:1.0:1789023782.502712:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893184 00000100:00100000:1.0:1789023782.502747:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023782.502756:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14365:x1875927024893184:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1789023782.502789:0:15024:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1789023782.503947:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023782.520331:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14365:x1875927024893184:12345-0@lo:5:osp-pre-1-0.0 Request processed in 17567us (17668us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789023782.520423:0:14365:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14365:1875927024893184:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789023782.520445:0:14365:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789023782.521717:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:02000400:3.0:1789023782.538415:0:16099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg348-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789023782.601610:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023783.627066:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023784.288239:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.288348:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007074304 00000100:00100000:1.0:1789023784.288358:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007074304 00000100:00100000:1.0:1789023784.288407:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:1.0:1789023784.288417:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1875927007074304:12345-192.168.203.48@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789023784.288453:0:14332:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 46ea25f4-7df3-498a-85ac-3ccb91540e61@192.168.203.48@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1789023784.288530:0:14332:0:(genops.c:1384:class_connect()) connect: client 46ea25f4-7df3-498a-85ac-3ccb91540e61, cookie 0xc3c1fcbfb3418fba 00000100:00080000:1.0:1789023784.288670:0:14332:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023784.288806:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+5:2360:x1875927007074304:12345-192.168.203.48@tcp:250:mount.lustre.0 Request processed in 388us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.288813:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 73 00000100:00100000:2.0:1789023784.295466:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023784.295709:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007074432 00000100:00100000:0.0:1789023784.295719:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007074432 00000100:00100000:0.0:1789023784.295781:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:0.0:1789023784.295791:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+5:13762:x1875927007074432:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789023784.295822:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023784.295838:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418fc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfcc6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023784.295878:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcc6 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023784.295889:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d04400/0xc3c1fcbfb3418fc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcc6 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023784.295898:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04400, rc 0) 00000100:00100000:0.0:1789023784.296053:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+6:13762:x1875927007074432:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 263us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023784.296061:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 74 00000100:00100000:2.0:1789023784.301300:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.301422:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007074560 00000100:00100000:1.0:1789023784.301435:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007074560 00000100:00100000:1.0:1789023784.301546:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:1.0:1789023784.301563:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+6:13762:x1875927007074560:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789023784.303330:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+6:13762:x1875927007074560:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 1758us (2032us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789023784.303346:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 75 00000100:00100000:2.0:1789023784.306865:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023784.306991:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007074688 00000100:00100000:0.0:1789023784.307005:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007074688 00000100:00100000:0.0:1789023784.307112:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:0.0:1789023784.307124:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+6:13762:x1875927007074688:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789023784.307147:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023784.307170:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3418fc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfccd expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023784.307206:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3418fc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfccd expref: 7 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023784.307219:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65c8d05400/0xc3c1fcbfb3418fc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfccd expref: 7 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023784.307251:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d05400, rc 0) 00000100:00100000:0.0:1789023784.307326:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+7:13762:x1875927007074688:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 204us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023784.307334:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 76 00000100:00100000:2.0:1789023784.310313:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023784.310711:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007074816 00000100:00100000:0.0:1789023784.310726:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007074816 00000100:00100000:1.0:1789023784.310987:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:1.0:1789023784.311003:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+7:13762:x1875927007074816:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789023784.312808:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13762:x1875927007074816:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 1797us (2496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.312823:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 77 00000100:00100000:2.0:1789023784.315376:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.315720:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007074944 00000100:00100000:1.0:1789023784.315733:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007074944 00000100:00100000:1.0:1789023784.315798:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:1.0:1789023784.315828:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13762:x1875927007074944:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789023784.316829:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13762:x1875927007074944:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 999us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.316855:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 78 00000100:00100000:2.0:1789023784.325932:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.326143:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075072 00000100:00100000:1.0:1789023784.326157:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075072 00000100:00100000:1.0:1789023784.326220:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:1.0:1789023784.326232:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c842cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13780:x1875927007075072:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023784.326719:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c842cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13780:x1875927007075072:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 487us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.326727:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 79 00000100:00100000:2.0:1789023784.337321:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.340327:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075200 00000100:00100000:1.0:1789023784.340349:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075200 00000100:00100000:1.0:1789023784.340449:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:1.0:1789023784.340462:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13780:x1875927007075200:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023784.341011:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13780:x1875927007075200:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 548us (3700us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.341020:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 80 00000100:00100000:2.0:1789023784.347665:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023784.348276:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075328 00000100:00100000:3.0:1789023784.348291:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075328 00000100:00100000:3.0:1789023784.348379:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:3.0:1789023784.348391:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+8:13762:x1875927007075328:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789023784.348413:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023784.348437:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713c000/0xc3c1fcbfb3418fcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfcf7 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023784.348473:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713c000/0xc3c1fcbfb3418fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcf7 expref: 9 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023784.348507:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713c000/0xc3c1fcbfb3418fcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcf7 expref: 9 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023784.348517:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c000, rc 0) 00000100:00100000:3.0:1789023784.348603:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+9:13762:x1875927007075328:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 214us (1555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023784.348611:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 81 00000100:00100000:2.0:1789023784.351612:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023784.351755:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075456 00000100:00100000:0.0:1789023784.351768:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075456 00000100:00100000:0.0:1789023784.351834:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:0.0:1789023784.351853:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+9:13762:x1875927007075456:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789023784.351885:0:14333:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789023784.351916:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789023784.351921:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789023784.351924:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789023784.351926:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1789023784.357165:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+9:13762:x1875927007075456:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 5303us (5547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.357183:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 82 00000100:00100000:0.0:1789023784.361048:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.361168:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075584 00000100:00100000:1.0:1789023784.361181:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075584 00000100:00100000:1.0:1789023784.361254:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:1.0:1789023784.361266:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+9:13762:x1875927007075584:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789023784.361307:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023784.361330:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfcfe expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023784.361367:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 10 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023784.361379:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 10 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023784.361390:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f66400, rc 0) 00000100:00100000:1.0:1789023784.361603:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13762:x1875927007075584:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 338us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.363294:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 83 00000100:00100000:2.0:1789023784.363752:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.364057:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075712 00000100:00100000:1.0:1789023784.364067:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075712 00000100:00100000:1.0:1789023784.364160:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:1.0:1789023784.364171:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13762:x1875927007075712:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789023784.364593:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13762:x1875927007075712:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 421us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.364601:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 84 00000100:00100000:0.0:1789023784.367564:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.367769:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075840 00000100:00100000:1.0:1789023784.367784:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075840 00000100:00100000:1.0:1789023784.367865:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:1.0:1789023784.367879:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13762:x1875927007075840:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789023784.368430:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13762:x1875927007075840:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 552us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.368448:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 85 00000100:00100000:0.0:1789023784.371208:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.371340:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007075968 00000100:00100000:1.0:1789023784.371353:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007075968 00000100:00100000:1.0:1789023784.371412:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:1.0:1789023784.371424:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13784:x1875927007075968:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023784.371791:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13784:x1875927007075968:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 370us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.371798:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 86 00000100:00100000:2.0:1789023784.374827:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.375021:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076096 00000100:00100000:1.0:1789023784.375035:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076096 00000100:00100000:1.0:1789023784.375146:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:1.0:1789023784.375160:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13784:x1875927007076096:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023784.375553:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13784:x1875927007076096:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 395us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.375562:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 87 00000100:00100000:0.0:1789023784.383467:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.384333:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076224 00000100:00100000:1.0:1789023784.384347:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076224 00000100:00100000:1.0:1789023784.384420:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1789023784.384431:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1875927007076224:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789023784.384468:0:14340:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 9cbc637b-4cf6-4660-9856-c105afa27f7e@192.168.203.48@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:1.0:1789023784.384579:0:14340:0:(genops.c:1384:class_connect()) connect: client 9cbc637b-4cf6-4660-9856-c105afa27f7e, cookie 0xc3c1fcbfb3418fdd 00000004:00100000:1.0:1789023784.384616:0:14340:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789023784.384623:0:14340:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789023784.432510:0:14340:0:(import.c:65:import_set_state_nolock()) ffff8e65fcba4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789023784.432654:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2360:x1875927007076224:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 48222us (49199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.432667:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1789023784.440629:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023784.440681:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.440993:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076480 00000100:00100000:1.0:1789023784.441007:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076480 00000100:00100000:1.0:1789023784.441171:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076352 00000100:00100000:1.0:1789023784.441175:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076352 00000100:00100000:1.0:1789023784.441194:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1789023784.441204:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:13762:x1875927007076480:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789023784.441259:0:14341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789023784.441363:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:13762:x1875927007076480:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 160us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.441371:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1789023784.441389:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1789023784.441394:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:0:x1875927007076352:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789023784.441404:0:14341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789023784.441423:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:0:x1875927007076352:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 29us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.441429:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00080000:3.0:1789023784.442366:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023784.444248:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.444680:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076608 00000100:00100000:1.0:1789023784.444695:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076608 00000100:00100000:1.0:1789023784.444960:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:1.0:1789023784.444982:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:13762:x1875927007076608:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789023784.445971:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:13762:x1875927007076608:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 992us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.445994:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:1.0:1789023784.453783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.454167:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023784.454278:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023784.454556:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076736 00000100:00100000:0.0:1789023784.454570:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076736 00000100:00100000:0.0:1789023784.454619:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076864 00000100:00100000:0.0:1789023784.454622:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076864 00000100:00100000:0.0:1789023784.454639:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1789023784.454650:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875927007076736:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789023784.454725:0:15023:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 9cbc637b-4cf6-4660-9856-c105afa27f7e@192.168.203.48@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1789023784.454764:0:15023:0:(genops.c:1384:class_connect()) connect: client 9cbc637b-4cf6-4660-9856-c105afa27f7e, cookie 0xc3c1fcbfb3418fe4 00002000:00100000:0.0:1789023784.454778:0:15023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9cbc637b-4cf6-4660-9856-c105afa27f7e/ffff8e65c63d9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789023784.454807:0:15023:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789023784.454843:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007076992 00000100:00100000:3.0:1789023784.454848:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007076992 00000100:00100000:3.0:1789023784.454886:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1789023784.454894:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:13762:x1875927007076992:12345-192.168.203.48@tcp:33:mount.lustre.0 00002000:00080000:0.0:1789023784.456123:0:15023:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789023784.456171:0:15023:0:(import.c:65:import_set_state_nolock()) ffff8e65c63de000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023784.456320:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2360:x1875927007076736:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 1670us (2550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023784.456332:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1789023784.456360:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789023784.456367:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1875927007076864:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789023784.456393:0:15023:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 9cbc637b-4cf6-4660-9856-c105afa27f7e@192.168.203.48@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:0.0:1789023784.456438:0:15023:0:(genops.c:1384:class_connect()) connect: client 9cbc637b-4cf6-4660-9856-c105afa27f7e, cookie 0xc3c1fcbfb3418feb 00002000:00100000:0.0:1789023784.456452:0:15023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9cbc637b-4cf6-4660-9856-c105afa27f7e/ffff8e65c63d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789023784.456504:0:15023:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00080000:3.0:1789023784.456552:0:14343:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1581us 00002000:00080000:0.0:1789023784.456683:0:15023:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789023784.456702:0:15023:0:(import.c:65:import_set_state_nolock()) ffff8e65c63d9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789023784.456733:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2360:x1875927007076864:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 365us (2566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023784.456740:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:1.0:1789023784.457960:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789023784.457998:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65ffcdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024893312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023784.458077:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023784.458171:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893312 00000100:00100000:1.0:1789023784.458180:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893312 00000100:00100000:1.0:1789023784.458248:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023784.458258:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024893312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023784.458280:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023784.458706:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024893312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 447us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023784.458715:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789023784.458742:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023784.458787:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65ffcdd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024893312:0@lo:13:osp-pre-0-0.0 00000004:00200000:3.0:1789023784.482465:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789023784.482633:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:13762:x1875927007076992:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 27731us (28346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023784.482647:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000001:00100000:1.0:1789023784.550333:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9cbc637b-4cf6-4660-9856-c105afa27f7e 00000100:00100000:1.0:1789023784.629220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023784.629308:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007077120 00000100:00100000:0.0:1789023784.629321:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007077120 00000100:00100000:0.0:1789023784.629397:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:0.0:1789023784.629410:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:13805:x1875927007077120:12345-192.168.203.48@tcp:101:mkdir.0 00010000:00010000:0.0:1789023784.629456:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023784.629527:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418ff2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd28 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023784.630439:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418ff9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023784.630461:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023784.630508:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023784.630805:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023784.630811:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023784.630931:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023784.630969:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3418ff2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd28 expref: 8 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023784.631009:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd28 expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023784.631019:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:2.0:1789023784.631022:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023784.631027:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023784.631169:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:13805:x1875927007077120:12345-192.168.203.48@tcp:101:mkdir.0 Request processed in 1760us (1961us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023784.631179:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00010000:00010000:2.0:1789023784.651533:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023785.673718:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789023786.505456:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.506057:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007077248 00000100:00100000:2.0:1789023786.506067:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007077248 00000100:00080000:1.0:1789023786.506423:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023786.506464:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:2.0:1789023786.506502:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:13858:x1875927007077248:12345-192.168.203.48@tcp:41:lfs.0 00000004:00000024:2.0:1789023786.506555:0:14341:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789023786.506650:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:13858:x1875927007077248:12345-192.168.203.48@tcp:41:lfs.0 Request processed in 177us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.506658:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789023786.512773:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.512868:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007077376 00000100:00100000:1.0:1789023786.512878:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007077376 00000100:00100000:1.0:1789023786.512954:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1789023786.512974:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:13858:x1875927007077376:12345-192.168.203.48@tcp:13:lfs.0 00002000:00000024:1.0:1789023786.513012:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023786.513098:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:13858:x1875927007077376:12345-192.168.203.48@tcp:13:lfs.0 Request processed in 135us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.513130:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00080000:3.0:1789023786.513205:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023786.515045:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023786.515147:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007077504 00000100:00100000:0.0:1789023786.515156:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007077504 00000100:00100000:0.0:1789023786.515330:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1789023786.515339:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:13858:x1875927007077504:12345-192.168.203.48@tcp:13:lfs.0 00002000:00000024:0.0:1789023786.515370:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023786.515447:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:13858:x1875927007077504:12345-192.168.203.48@tcp:13:lfs.0 Request processed in 109us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023786.515454:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00080000:3.0:1789023786.518980:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023786.685036:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.685505:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007077632 00000100:00100000:1.0:1789023786.685516:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007077632 00000100:00100000:1.0:1789023786.685575:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:1.0:1789023786.685586:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+10:13888:x1875927007077632:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789023786.685603:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023786.685622:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e64c2f67a00/0xc3c1fcbfb3419000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd2f expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023786.685649:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e64c2f67a00/0xc3c1fcbfb3419000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd2f expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023786.686937:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e64c2f67a00/0xc3c1fcbfb3419000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd2f expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023786.686948:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f67a00, rc 0) 00000100:00100000:1.0:1789023786.687036:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13888:x1875927007077632:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 1451us (2009us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.687043:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 88 00000100:00100000:1.0:1789023786.693889:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.694012:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007077760 00000100:00100000:2.0:1789023786.694023:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007077760 00000100:00100000:2.0:1789023786.694085:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 89 00000100:00100000:2.0:1789023786.694097:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13888:x1875927007077760:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789023786.694395:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13888:x1875927007077760:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 300us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.694403:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 89 00010000:00010000:2.0:1789023786.699489:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023786.700633:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023786.700868:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007077888 00000100:00100000:3.0:1789023786.700878:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007077888 00000100:00100000:3.0:1789023786.700929:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:3.0:1789023786.700939:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13888:x1875927007077888:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789023786.701313:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13888:x1875927007077888:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 375us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023786.701321:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 90 00000100:00100000:0.0:1789023786.707062:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.707333:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078016 00000100:00100000:1.0:1789023786.707342:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078016 00000100:00100000:1.0:1789023786.707399:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:1.0:1789023786.707409:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13897:x1875927007078016:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023786.707712:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13897:x1875927007078016:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 303us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.707727:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 91 00000100:00100000:1.0:1789023786.743796:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023786.743972:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078144 00000100:00100000:3.0:1789023786.743983:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078144 00000100:00100000:3.0:1789023786.744075:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:3.0:1789023786.744087:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13897:x1875927007078144:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789023786.744372:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13897:x1875927007078144:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 286us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023786.744380:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 92 00000100:00100000:0.0:1789023786.753465:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.753577:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078272 00000100:00100000:2.0:1789023786.753587:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078272 00000100:00100000:2.0:1789023786.753641:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:2.0:1789023786.753650:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13888:x1875927007078272:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789023786.753664:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023786.753681:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d06600/0xc3c1fcbfb3419007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd59 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023786.753711:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d06600/0xc3c1fcbfb3419007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd59 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023786.753722:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d06600/0xc3c1fcbfb3419007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd59 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023786.753732:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06600, rc 0) 00000100:00100000:2.0:1789023786.753788:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13888:x1875927007078272:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 139us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.753796:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 93 00000100:00100000:0.0:1789023786.758254:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023786.763687:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078400 00000100:00100000:3.0:1789023786.763717:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078400 00000100:00100000:2.0:1789023786.766896:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:2.0:1789023786.766920:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f79c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13888:x1875927007078400:12345-192.168.203.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789023786.766969:0:14334:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789023786.766988:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789023786.766992:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789023786.766995:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789023786.766997:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789023786.770386:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f79c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13888:x1875927007078400:12345-192.168.203.48@tcp:256:mount.lustre.0 Request processed in 3376us (12038us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.770400:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 94 00000100:00100000:0.0:1789023786.780523:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.780982:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078528 00000100:00100000:2.0:1789023786.780992:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078528 00000100:00100000:2.0:1789023786.781049:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:2.0:1789023786.781059:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13888:x1875927007078528:12345-192.168.203.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789023786.781073:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023786.781090:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd60 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023786.781115:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 13 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023786.781126:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 13 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023786.781134:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07600, rc 0) 00000100:00100000:2.0:1789023786.781794:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13888:x1875927007078528:12345-192.168.203.48@tcp:101:mount.lustre.0 Request processed in 734us (1277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.781803:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 95 00000100:00100000:0.0:1789023786.787043:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.787153:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078656 00000100:00100000:2.0:1789023786.787268:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078656 00000100:00100000:2.0:1789023786.787331:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:2.0:1789023786.787340:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13888:x1875927007078656:12345-192.168.203.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789023786.787624:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13888:x1875927007078656:12345-192.168.203.48@tcp:501:mount.lustre.0 Request processed in 284us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.787631:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 96 00000100:00100000:0.0:1789023786.791475:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.791724:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078784 00000100:00100000:1.0:1789023786.791734:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078784 00000100:00100000:1.0:1789023786.791798:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:1.0:1789023786.791808:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13888:x1875927007078784:12345-192.168.203.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789023786.792219:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13888:x1875927007078784:12345-192.168.203.48@tcp:503:mount.lustre.0 Request processed in 412us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.792229:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 97 00000100:00100000:0.0:1789023786.795895:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.796163:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007078912 00000100:00100000:1.0:1789023786.796182:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007078912 00000100:00100000:1.0:1789023786.796244:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:1.0:1789023786.796254:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13901:x1875927007078912:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023786.796803:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13901:x1875927007078912:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 548us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.796811:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 98 00000100:00100000:0.0:1789023786.800661:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.800818:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079040 00000100:00100000:1.0:1789023786.800828:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079040 00000100:00100000:1.0:1789023786.800929:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:1.0:1789023786.800939:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13901:x1875927007079040:12345-192.168.203.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789023786.801231:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13901:x1875927007079040:12345-192.168.203.48@tcp:502:llog_process_th.0 Request processed in 292us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.801242:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 99 00000100:00100000:0.0:1789023786.806075:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.806518:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079168 00000100:00100000:2.0:1789023786.806528:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079168 00000100:00100000:2.0:1789023786.806576:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023786.806584:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2360:x1875927007079168:12345-192.168.203.48@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789023786.806613:0:14340:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from bbc2932e-2ebc-4490-aab0-35e306ea0896@192.168.203.48@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1789023786.806651:0:14340:0:(genops.c:1384:class_connect()) connect: client bbc2932e-2ebc-4490-aab0-35e306ea0896, cookie 0xc3c1fcbfb3419015 00000004:00100000:2.0:1789023786.806680:0:14340:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789023786.806800:0:14340:0:(import.c:65:import_set_state_nolock()) ffff8e65e77ac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023786.806872:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:2360:x1875927007079168:12345-192.168.203.48@tcp:38:mount.lustre.0 Request processed in 286us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.806880:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:0.0:1789023786.811898:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023786.811941:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.812164:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079296 00000100:00100000:1.0:1789023786.812181:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079296 00000100:00100000:1.0:1789023786.812305:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079424 00000100:00100000:1.0:1789023786.812310:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079424 00000100:00100000:1.0:1789023786.812328:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789023786.812338:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+7:0:x1875927007079296:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789023786.812366:0:14340:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789023786.812429:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+7:0:x1875927007079296:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 91us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.812436:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789023786.812454:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:1.0:1789023786.812461:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:13888:x1875927007079424:12345-192.168.203.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789023786.812471:0:14340:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789023786.812520:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:13888:x1875927007079424:12345-192.168.203.48@tcp:41:mount.lustre.0 Request processed in 59us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023786.812526:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00080000:3.0:1789023786.812576:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023786.820681:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.821763:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079552 00000100:00100000:2.0:1789023786.821774:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079552 00000100:00100000:2.0:1789023786.821854:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:2.0:1789023786.821872:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:13888:x1875927007079552:12345-192.168.203.48@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789023786.821986:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:13888:x1875927007079552:12345-192.168.203.48@tcp:40:mount.lustre.0 Request processed in 122us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.821993:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789023786.831848:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.831887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023786.831919:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023786.832085:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079680 00000100:00100000:2.0:1789023786.832107:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079680 00000100:00100000:2.0:1789023786.832152:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079808 00000100:00100000:2.0:1789023786.832155:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079808 00000100:00100000:2.0:1789023786.832171:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023786.832184:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875927007079680:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789023786.832216:0:15022:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from bbc2932e-2ebc-4490-aab0-35e306ea0896@192.168.203.48@tcp t0 exp 0000000000000000 cur 452 last 0 00000100:00100000:3.0:1789023786.832218:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007079936 00000100:00100000:3.0:1789023786.832222:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007079936 00000100:00100000:3.0:1789023786.832254:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1789023786.832262:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:13888:x1875927007079936:12345-192.168.203.48@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789023786.832327:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000020:00000080:2.0:1789023786.832354:0:15022:0:(genops.c:1384:class_connect()) connect: client bbc2932e-2ebc-4490-aab0-35e306ea0896, cookie 0xc3c1fcbfb341901c 00002000:00100000:2.0:1789023786.832365:0:15022:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli bbc2932e-2ebc-4490-aab0-35e306ea0896/ffff8e65e77a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789023786.832375:0:15022:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1789023786.832407:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:13888:x1875927007079936:12345-192.168.203.48@tcp:33:mount.lustre.0 Request processed in 146us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023786.832414:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00002000:00080000:2.0:1789023786.834106:0:15022:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789023786.834149:0:15022:0:(import.c:65:import_set_state_nolock()) ffff8e65dddef800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023786.834265:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:2360:x1875927007079680:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 2083us (2376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.834274:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:2.0:1789023786.834303:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789023786.834310:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1875927007079808:12345-192.168.203.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789023786.834333:0:15022:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from bbc2932e-2ebc-4490-aab0-35e306ea0896@192.168.203.48@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1789023786.834360:0:15022:0:(genops.c:1384:class_connect()) connect: client bbc2932e-2ebc-4490-aab0-35e306ea0896, cookie 0xc3c1fcbfb3419023 00002000:00100000:2.0:1789023786.834370:0:15022:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli bbc2932e-2ebc-4490-aab0-35e306ea0896/ffff8e65f6e5b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789023786.834380:0:15022:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789023786.834460:0:15022:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789023786.834507:0:15022:0:(import.c:65:import_set_state_nolock()) ffff8e65f6e58000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789023786.834546:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:2360:x1875927007079808:12345-192.168.203.48@tcp:8:mount.lustre.0 Request processed in 234us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023786.834554:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789023786.995787:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023786.995936:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080064 00000100:00100000:0.0:1789023786.995945:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080064 00000100:00100000:0.0:1789023786.996019:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1789023786.996030:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:13922:x1875927007080064:12345-192.168.203.48@tcp:101:mkdir.0 00010000:00010000:0.0:1789023786.996049:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789023786.996069:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04e00/0xc3c1fcbfb341902a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd8a expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023786.996141:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023786.996155:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023786.996169:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023786.996204:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789023786.996208:0:14342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789023786.996242:0:14342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023786.996268:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04e00/0xc3c1fcbfb341902a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023786.996286:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 7 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023786.996294:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:0.0:1789023786.996306:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789023786.996310:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65c8d04600, rc 0) 00000100:00100000:0.0:1789023786.996377:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+7:13922:x1875927007080064:12345-192.168.203.48@tcp:101:mkdir.0 Request processed in 348us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023786.996384:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:0.0:1789023787.529984:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024893824:0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.530026:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024893440:0@lo:400:kworker.0 00000100:00100000:2.0:1789023787.530037:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024893696:0@lo:400:kworker.0 00000100:00100000:0.0:1789023787.530051:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023787.530393:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023787.530414:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023787.530430:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024893568:0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.530453:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893824 00000100:00100000:2.0:1789023787.530460:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023787.530461:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893824 00000100:00100000:1.0:1789023787.530528:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023787.530536:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024893824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.530663:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024893824:12345-0@lo:400:kworker.0 Request processed in 128us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023787.530684:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789023787.530709:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893696 00000100:00100000:1.0:1789023787.530713:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893696 00000100:00100000:1.0:1789023787.530745:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893568 00000100:00100000:1.0:1789023787.530748:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893568 00000100:00100000:1.0:1789023787.530763:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023787.530769:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024893696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.530807:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024893696:12345-0@lo:400:kworker.0 Request processed in 38us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023787.530813:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789023787.530825:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789023787.530830:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024893568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.530862:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024893568:12345-0@lo:400:kworker.0 Request processed in 32us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023787.530867:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789023787.530914:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024893824:0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.530918:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7981180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024893696:0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.530928:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024894208:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789023787.530966:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789023787.530971:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023787.531001:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024893952:0@lo:400:kworker.0 00000100:00100000:0.0:1789023787.531046:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023787.531093:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893440 00000100:00100000:0.0:1789023787.531097:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893440 00000100:00100000:1.0:1789023787.531295:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023787.531344:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024894208 00000100:00100000:1.0:1789023787.531349:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024894208 00000100:00100000:1.0:1789023787.531377:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023787.531384:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024894208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789023787.531400:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023787.531522:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024894208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023787.531538:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023787.531571:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024894208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023787.531986:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789023787.531996:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:3312:x1875927024893440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023787.532040:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:3312:x1875927024893440:12345-0@lo:400:kworker.0 Request processed in 47us (1628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023787.532048:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789023787.532052:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024893568:0@lo:400:kworker.0 00000100:00100000:2.0:1789023787.532061:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f7982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024894080:0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.532069:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7980000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024893440:0@lo:400:kworker.0 00000100:00100000:2.0:1789023787.532093:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023787.533379:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024893952 00000100:00100000:0.0:1789023787.533379:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024894080 00000100:00100000:0.0:1789023787.533390:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024894080 00000100:00100000:1.0:1789023787.533391:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024893952 00000100:00100000:1.0:1789023787.533441:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023787.533450:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024893952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.533528:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875927024893952:12345-0@lo:400:kworker.0 Request processed in 78us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023787.533536:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789023787.533578:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7983100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1875927024893952:0@lo:400:kworker.0 00000100:00080000:1.0:1789023787.533602:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023787.533728:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789023787.533735:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024894080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789023787.533775:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024894080:12345-0@lo:400:kworker.0 Request processed in 41us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023787.533782:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1789023787.533798:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023787.535900:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f7982a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024894080:0@lo:400:kworker.0 00000001:00100000:0.0:1789023787.614353:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9cbc637b-4cf6-4660-9856-c105afa27f7e 00000001:00080000:0.0:1789023787.614372:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789023787.614415:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of bbc2932e-2ebc-4490-aab0-35e306ea0896 00000001:00100000:0.0:1789023787.614421:0:7659:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1789023787.722268:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023788.750673:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023789.415929:0:16301:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789023789.577862:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024894336:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789023789.577962:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023789.578054:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024894336 00000100:00100000:1.0:1789023789.578063:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024894336 00000100:00100000:1.0:1789023789.578130:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789023789.578142:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024894336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023789.578195:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789023789.578250:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024894336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023789.578258:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1789023789.578286:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023789.578873:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024894336:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1789023789.635569:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9cbc637b-4cf6-4660-9856-c105afa27f7e 00000001:00100000:3.0:1789023789.635596:0:5867:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of bbc2932e-2ebc-4490-aab0-35e306ea0896 00000001:00100000:1.0:1789023789.654057:0:6722:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of bbc2932e-2ebc-4490-aab0-35e306ea0896 00010000:00010000:0.0:1789023789.770020:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023790.793698:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789023791.312876:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789023791.817689:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023792.110783:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023792.110896:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023792.110965:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023792.111002:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080320 00000100:00100000:1.0:1789023792.111012:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080320 00000100:00100000:1.0:1789023792.111071:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:1.0:1789023792.111083:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2364:x1875927007080320:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023792.111156:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7982a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2364:x1875927007080320:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 76us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023792.111164:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00080000:1.0:1789023792.111184:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789023792.111378:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023792.111400:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023792.111450:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080576 00000100:00100000:3.0:1789023792.111455:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080576 00000100:00100000:3.0:1789023792.111515:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080832 00000100:00100000:3.0:1789023792.111518:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080832 00000100:00100000:3.0:1789023792.111534:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789023792.111541:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007080576:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023792.111630:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007080576:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.111638:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789023792.111653:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789023792.111660:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007080832:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023792.111685:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7983800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007080832:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 26us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.111705:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00080000:3.0:1789023792.111783:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789023792.111786:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023792.111978:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023792.112001:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023792.112015:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080192 00000100:00100000:0.0:1789023792.112019:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080192 00000100:00100000:0.0:1789023792.112045:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:0.0:1789023792.112052:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:2364:x1875927007080192:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023792.112082:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:2364:x1875927007080192:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 31us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023792.112089:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 101 00000100:00100000:0.0:1789023792.112114:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080704 00000100:00100000:0.0:1789023792.112118:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080704 00000100:00100000:0.0:1789023792.112146:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1789023792.112153:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:2364:x1875927007080704:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023792.112179:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:2364:x1875927007080704:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023792.112185:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00080000:0.0:1789023792.112203:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789023792.112695:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080448 00000100:00100000:3.0:1789023792.112701:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080448 00000100:00100000:3.0:1789023792.112733:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007080960 00000100:00100000:3.0:1789023792.112736:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007080960 00000100:00100000:3.0:1789023792.112819:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1789023792.112826:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007080448:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023792.112868:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7980000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007080448:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 42us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.112874:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1789023792.112888:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:3.0:1789023792.112894:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007080960:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023792.112918:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007080960:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 24us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.112934:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00080000:0.0:1789023792.113114:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789023792.113118:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1789023792.416124:0:16453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc01e62280 20000000:00000080:1.0:1789023792.416140:0:16453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e65ee383000 uarg=0000000000000000 20000000:01000000:1.0:1789023792.416187:0:16453:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789023792.416193:0:16453:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789023792.416197:0:16453:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789023792.417097:0:16454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789023792.417386:0:16453:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789023792.424789:0:16453:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789023792.424821:0:16453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424839:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 18 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424865:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424871:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424880:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424886:0:16453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424892:0:16453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424944:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.424960:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 12 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.424976:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894464:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023792.425092:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 12 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.425101:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 12 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.425109:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894592:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023792.425148:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.425156:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 18 pid: 14333 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.425165:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2246d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894720:0@lo:104: 00000100:00100000:1.0:1789023792.426456:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789023792.426824:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 18 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.426836:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 18 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.426848:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2247100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894848:0@lo:104: 00000100:00100000:1.0:1789023792.426875:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789023792.429443:0:16453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 18 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.429459:0:16453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 18 pid: 14334 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.429472:0:16453:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2247480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894976:0@lo:104: 00000100:00100000:1.0:1789023792.429554:0:16453:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023792.429820:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024894720 00000100:00100000:3.0:1789023792.429828:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024894720 00000100:00100000:3.0:1789023792.429867:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024894848 00000100:00100000:3.0:1789023792.429870:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024894848 00000100:00100000:3.0:1789023792.429885:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023792.429893:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+4:16453:x1875927024894720:12345-0@lo:104: 00010000:00010000:3.0:1789023792.429907:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.429987:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789023792.429993:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+4:16453:x1875927024894720:12345-0@lo:104: Request processed in 101us (3539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.429999:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789023792.430017:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789023792.430022:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:16453:x1875927024894848:12345-0@lo:104: 00010000:00010000:3.0:1789023792.430030:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.430060:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789023792.430065:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:16453:x1875927024894848:12345-0@lo:104: Request processed in 44us (3190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.430069:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789023792.430091:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789023792.430097:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.430104:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c600 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023792.430107:0:14329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.430115:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023792.430121:0:14329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023792.430127:0:14329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023792.430162:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023792.430368:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023792.430393:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023792.430412:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081216 00000100:00100000:2.0:1789023792.430415:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081216 00010000:00010000:2.0:1789023792.430435:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 13 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023792.430453:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081088 00000100:00100000:2.0:1789023792.430456:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081088 00010000:00010000:2.0:1789023792.430465:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 14 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023792.430495:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1789023792.430503:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ea25f4-7df3-498a-85ac-3ccb91540e61+14:2363:x1875927007081216:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023792.430512:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023792.430517:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 14 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023792.430538:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 14 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023792.430564:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023792.430601:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ea25f4-7df3-498a-85ac-3ccb91540e61+14:2363:x1875927007081216:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023792.430607:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:2.0:1789023792.430622:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:2.0:1789023792.430640:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:2363:x1875927007081088:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023792.430648:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023792.430651:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 13 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023792.430660:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 13 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023792.430669:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023792.430685:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:2363:x1875927007081088:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 47us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023792.430690:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00010000:00010000:3.0:1789023792.431110:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023792.431168:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023792.431348:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789023792.431364:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024895104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789023792.431408:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023792.431455:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024895104 00000100:00100000:0.0:1789023792.431460:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024895104 00010000:00010000:3.0:1789023792.431603:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e713c600/0xc3c1fcbfb3418ea9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418eb0 expref: -99 pid: 15742 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.431619:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789023792.431797:0:16453:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06c76c0 going to sleep for 11 seconds 00010000:00010000:1.0:1789023792.431821:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65f6d07600/0xc3c1fcbfb341900e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd60 expref: 12 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.431835:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c97800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894464:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023792.431863:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e64c2f66400/0xc3c1fcbfb3418fd6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfcfe expref: 11 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.431872:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65f6c95180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894592:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023792.431881:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2246d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894720:0@lo:104: 00000100:00100000:1.0:1789023792.431889:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2247100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894848:0@lo:104: 00010000:00010000:3.0:1789023792.431933:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.431941:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023792.431944:0:14329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.431952:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789023792.431958:0:14329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023792.431964:0:14329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023792.431987:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.431992:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023792.432014:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.432031:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05e00/0xc3c1fcbfb3418d75 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d7c expref: -99 pid: 15021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.432041:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023792.432043:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023792.432044:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023792.432051:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789023792.432062:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023792.432071:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024895232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023792.432100:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023792.432127:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024895232 00000100:00100000:3.0:1789023792.432131:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024895232 00010000:00010000:3.0:1789023792.432145:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 20 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023792.432166:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789023792.432309:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 20 pid: 14333 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023792.432326:0:14327:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789023792.432332:0:14327:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789023792.432461:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789023792.432469:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c191d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+20:3313:x1875927024895104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023792.432727:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789023792.432740:0:14323:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024894976 00000100:00100000:2.0:1789023792.432744:0:14323:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024894976 00000100:00100000:2.0:1789023792.432771:0:14323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789023792.432778:0:14323:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:16453:x1875927024894976:12345-0@lo:104: 00010000:00010000:2.0:1789023792.432789:0:14323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023792.432837:0:14323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789023792.432849:0:14323:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+3:16453:x1875927024894976:12345-0@lo:104: Request processed in 72us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023792.432856:0:14323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789023792.432978:0:16453:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2247480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16453:1875927024894976:0@lo:104: 00010000:00010000:1.0:1789023792.433003:0:16453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.433050:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023792.433056:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 20 pid: 14333 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.433066:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 20 pid: 14333 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.433079:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65ee3eb600/0xc3c1fcbfb3418eb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3418ea9 expref: 20 pid: 14333 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.433090:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023792.433126:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c191d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+19:3313:x1875927024895104:12345-0@lo:103:ldlm_bl.0 Request processed in 658us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023792.433133:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789023792.433339:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+18:3312:x1875927024895232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789023792.433348:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023792.433353:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 18 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.433361:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 18 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.433370:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65f6d07200/0xc3c1fcbfb3418d7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d75 expref: 18 pid: 14332 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.433378:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023792.433422:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:96e4333f-cc82-4def-9373-4ed84d9f7775+17:3312:x1875927024895232:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.433428:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789023792.433449:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789023792.433454:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.433461:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e707e200 already unused, calling callback (ffffffffc1d87c20) 10000000:00010000:3.0:1789023792.433465:0:14329:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.433473:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023792.433717:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024895104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023792.433843:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:96e4333f-cc82-4def-9373-4ed84d9f7775:3312:1875927024895232:0@lo:103:ldlm_bl.0 10000000:00010000:3.0:1789023792.433978:0:14329:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789023792.433984:0:14329:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789023792.434016:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.434021:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789023792.434052:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.434058:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.148@tcp lock: ffff8e65e707e200/0xc3c1fcbfb3418d28 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc3c1fcbfb3418d2f expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023792.434071:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023792.434073:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789023792.434075:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023792.434148:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789023792.434160:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96e4333f-cc82-4def-9373-4ed84d9f7775:3311:1875927024895360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789023792.434203:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023792.434366:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024895360 00000100:00100000:0.0:1789023792.434372:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024895360 00010000:00010000:0.0:1789023792.434399:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 17 pid: 14334 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023792.434427:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023792.434434:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:3311:x1875927024895360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789023792.434442:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023792.434446:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 17 pid: 14334 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434455:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 17 pid: 14334 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434465:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e65c8d04a00/0xc3c1fcbfb3418d2f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc3c1fcbfb3418d28 expref: 17 pid: 14334 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434847:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434857:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434873:0:14327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434880:0:14327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434887:0:14327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434893:0:14327:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434909:0:14327:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67e00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023792.434912:0:14327:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434919:0:14327:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434946:0:14327:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023792.434956:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023792.434998:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96e4333f-cc82-4def-9373-4ed84d9f7775+16:3311:x1875927024895360:12345-0@lo:103:ldlm_bl.0 Request processed in 564us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023792.435005:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789023792.435054:0:16453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.435063:0:16453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023792.435069:0:16453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e64c2f67e00/0xc3c1fcbfb3419038 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023792.435331:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:96e4333f-cc82-4def-9373-4ed84d9f7775:3311:1875927024895360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789023792.649721:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024895488:0@lo:400:kworker.0 00000100:00100000:2.0:1789023792.649736:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024895616:0@lo:400:kworker.0 00000100:00100000:3.0:1789023792.649800:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023792.649800:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024895872:0@lo:400:kworker.0 00000100:00100000:1.0:1789023792.649848:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023792.649866:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024896000:0@lo:400:kworker.0 00000100:00100000:1.0:1789023792.649887:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024895744:0@lo:400:kworker.0 00000100:00100000:3.0:1789023792.649895:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023792.649918:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023792.649948:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024895488 00000100:00100000:1.0:1789023792.649956:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789023792.649957:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024895488 00000100:00100000:1.0:1789023792.649965:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024896128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789023792.649991:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023792.650019:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789023792.650030:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024895488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023792.650082:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875927024895488:12345-0@lo:400:kworker.0 Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.650091:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789023792.650117:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024895872 00000100:00100000:3.0:1789023792.650121:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024895872 00000100:00100000:3.0:1789023792.650143:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896000 00000100:00100000:3.0:1789023792.650146:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896000 00000100:00100000:3.0:1789023792.650159:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024895744 00000100:00100000:3.0:1789023792.650161:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024895744 00000100:00100000:3.0:1789023792.650175:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023792.650182:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024895872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023792.650223:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875927024895872:12345-0@lo:400:kworker.0 Request processed in 42us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.650229:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789023792.650241:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789023792.650246:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024896000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023792.650286:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875927024896000:12345-0@lo:400:kworker.0 Request processed in 40us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023792.650291:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789023792.650320:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023792.650330:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024895744:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789023792.650339:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789023792.650345:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023792.650358:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023792.650378:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875927024895744:12345-0@lo:400:kworker.0 Request processed in 49us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023792.650386:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789023792.650410:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024895616 00000100:00100000:1.0:1789023792.650414:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024895616 00000100:00100000:1.0:1789023792.650444:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023792.650450:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024895616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023792.651756:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896128 00000100:00100000:0.0:1789023792.651769:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896128 00000100:00100000:0.0:1789023792.651811:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023792.651818:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875927024896128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789023792.651846:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023792.651898:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2246d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875927024896128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023792.651905:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789023792.651964:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1875927024895872:0@lo:400:kworker.0 00000100:00100000:0.0:1789023792.651992:0:3313:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789023792.652005:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024896128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789023792.652015:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875927024895744:0@lo:400:kworker.0 00000100:00080000:0.0:1789023792.653403:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789023792.653466:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1875927024896000:0@lo:400:kworker.0 00000100:00100000:0.0:1789023792.653516:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1875927024895488:0@lo:400:kworker.0 00000100:00100000:1.0:1789023792.653799:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024895616:12345-0@lo:400:kworker.0 Request processed in 3337us (3428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023792.653816:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789023792.656191:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024895616:0@lo:400:kworker.0 00010000:00010000:0.0:1789023792.843615:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023793.865637:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789023794.123225:0:14337:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789023794.123233:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e64c1193000 from 10 10000000:01000000:0.0:1789023794.123238:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023794.123286:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04e00/0xc3c1fcbfb341903f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.123299:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04e00/0xc3c1fcbfb341903f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.123311:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04e00/0xc3c1fcbfb341903f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023794.123336:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023794.123403:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023794.123462:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd9480 going to sleep for 11 seconds 00000100:00100000:2.0:1789023794.124265:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896256 00000100:00100000:2.0:1789023794.124274:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896256 00000100:00100000:2.0:1789023794.124332:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789023794.124342:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+16:14337:x1875927024896256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023794.124357:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023794.124375:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d06200/0xc3c1fcbfb3419046 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb341903f expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023794.124402:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d06200/0xc3c1fcbfb3419046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb341903f expref: 17 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023794.124412:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d06200/0xc3c1fcbfb3419046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb341903f expref: 17 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023794.124420:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06200, rc 0) 00000100:00100000:2.0:1789023794.124532:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+17:14337:x1875927024896256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 191us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023794.124657:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789023794.124770:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7315180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023794.124788:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04e00/0xc3c1fcbfb341903f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419046 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023794.124798:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04e00/0xc3c1fcbfb341903f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3419046 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023794.124864:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.124894:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023794.124940:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023794.125110:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896384 00000100:00100000:2.0:1789023794.125116:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896384 00000100:00100000:2.0:1789023794.125151:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789023794.125157:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:14337:x1875927024896384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023794.125396:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+17:14337:x1875927024896384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 238us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023794.125403:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789023794.125512:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.125751:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.125791:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023794.125809:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e64c3208540 going to sleep for 11 seconds 00000100:00100000:0.0:1789023794.125877:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896512 00000100:00100000:0.0:1789023794.125882:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896512 00000100:00100000:0.0:1789023794.125927:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789023794.125935:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+17:14337:x1875927024896512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023794.126086:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+17:14337:x1875927024896512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023794.126093:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789023794.126131:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789023794.135530:0:16552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789023794.136649:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789023794.136675:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023794.136686:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04e00/0xc3c1fcbfb341903f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419046 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.136697:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d04e00/0xc3c1fcbfb341903f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419046 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023794.136708:0:14337:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789023794.136711:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65e6d8b800 from 10 10000000:01000000:0.0:1789023794.136714:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023794.136751:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb341904d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.136760:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb341904d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.136770:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb341904d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023794.136795:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023794.136866:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023794.136907:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd9300 going to sleep for 11 seconds 00000100:00100000:1.0:1789023794.137804:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896640 00000100:00100000:1.0:1789023794.137813:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896640 00000100:00100000:1.0:1789023794.137872:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789023794.137881:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+17:14337:x1875927024896640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023794.137893:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023794.137907:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e64c2f67400/0xc3c1fcbfb3419054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb341904d expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023794.137942:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e64c2f67400/0xc3c1fcbfb3419054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb341904d expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023794.137952:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e64c2f67400/0xc3c1fcbfb3419054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb341904d expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023794.137959:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f67400, rc 0) 00000100:00100000:1.0:1789023794.138010:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:14337:x1875927024896640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023794.138024:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789023794.141659:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7315500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789023794.141691:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb341904d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419054 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023794.141704:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb341904d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3419054 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023794.141793:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2244e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789023794.142700:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023794.142744:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d29653c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789023794.151305:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896768 00000100:00100000:3.0:1789023794.151321:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896768 00000100:00100000:3.0:1789023794.151378:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789023794.151388:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+18:14337:x1875927024896768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.152114:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+18:14337:x1875927024896768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 726us (9415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023794.152123:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789023794.152213:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2244e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023794.152264:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023794.152309:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023794.152345:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023794.152389:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024896896 00000100:00100000:3.0:1789023794.152400:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024896896 00000100:00100000:3.0:1789023794.152835:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789023794.152844:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+18:14337:x1875927024896896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.153023:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96e4333f-cc82-4def-9373-4ed84d9f7775+18:14337:x1875927024896896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023794.153030:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789023794.153113:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18dd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024896896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789023794.155153:0:16554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789023794.155227:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789023794.155249:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023794.155261:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb341904d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419054 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.155287:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05c00/0xc3c1fcbfb341904d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419054 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789023794.155298:0:14337:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789023794.155301:0:14337:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8e65e74a3000 from 10 10000000:01000000:0.0:1789023794.155303:0:14337:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789023794.155340:0:14337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05200/0xc3c1fcbfb341905b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.155348:0:14337:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05200/0xc3c1fcbfb341905b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.155358:0:14337:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05200/0xc3c1fcbfb341905b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023794.155382:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024897024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789023794.155452:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023794.156073:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2b6b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789023794.156175:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024897024 00000100:00100000:2.0:1789023794.156182:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024897024 00000100:00100000:2.0:1789023794.156221:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789023794.156230:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+18:14337:x1875927024897024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789023794.156243:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023794.156257:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65f6d07000/0xc3c1fcbfb3419062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c1fcbfb341905b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023794.156278:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65f6d07000/0xc3c1fcbfb3419062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc3c1fcbfb341905b expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023794.156288:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65f6d07000/0xc3c1fcbfb3419062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc3c1fcbfb341905b expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023794.156297:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07000, rc 0) 00000100:00100000:2.0:1789023794.156357:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:14337:x1875927024897024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023794.156363:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789023794.156452:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024897024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789023794.156466:0:14337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05200/0xc3c1fcbfb341905b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419062 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.156511:0:14337:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05200/0xc3c1fcbfb341905b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc3c1fcbfb3419062 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023794.157021:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024897152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789023794.157055:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023794.157094:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2b6b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789023794.159617:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024897152 00000100:00100000:1.0:1789023794.159631:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024897152 00000100:00100000:1.0:1789023794.159675:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789023794.159684:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+19:14337:x1875927024897152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023794.160103:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e7314000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024897152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789023794.160154:0:14337:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c18ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024897280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789023794.164193:0:14337:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023794.164291:0:14337:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d069d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789023794.169672:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024897280 00000100:00100000:3.0:1789023794.169688:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024897280 00000100:00100000:0.0:1789023794.170328:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789023794.170340:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ddc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+20:14337:x1875927024897280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789023794.170627:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+20:14337:x1875927024897280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 288us (6439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023794.170635:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789023794.170701:0:14337:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c18ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:96e4333f-cc82-4def-9373-4ed84d9f7775:14337:1875927024897280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023794.170764:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ddc4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96e4333f-cc82-4def-9373-4ed84d9f7775+19:14337:x1875927024897152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 11078us (13705us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023794.170774:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000040:00080000:0.0:1789023794.171378:0:16556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789023794.171428:0:14337:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789023794.171446:0:14337:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789023794.171455:0:14337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05200/0xc3c1fcbfb341905b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419062 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023794.171467:0:14337:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.148@tcp lock: ffff8e65c8d05200/0xc3c1fcbfb341905b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc3c1fcbfb3419062 expref: -99 pid: 14337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023794.285823:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023794.285893:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081344 00000100:00100000:3.0:1789023794.285902:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081344 00000100:00100000:3.0:1789023794.285964:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:3.0:1789023794.285974:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+11:13776:x1875927007081344:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023794.285991:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023794.286008:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3419069 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd91 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023794.286037:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3419069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd91 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023794.286048:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713da00/0xc3c1fcbfb3419069 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd91 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023794.286056:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713da00, rc 0) 00000100:00100000:3.0:1789023794.286108:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13776:x1875927007081344:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 136us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023794.286116:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 111 00000100:00100000:2.0:1789023794.302994:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023794.304679:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081472 00000100:00100000:3.0:1789023794.304698:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081472 00000100:00100000:3.0:1789023794.304815:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:3.0:1789023794.304826:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13776:x1875927007081472:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.305118:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13776:x1875927007081472:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 293us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023794.305126:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 112 00000100:00100000:3.0:1789023794.314642:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023794.314924:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081600 00000100:00100000:1.0:1789023794.314934:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081600 00000100:00100000:1.0:1789023794.314988:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:1.0:1789023794.314998:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13776:x1875927007081600:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789023794.315292:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13776:x1875927007081600:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 294us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023794.315310:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 113 00000100:00100000:2.0:1789023794.324591:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023794.324668:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081728 00000100:00100000:3.0:1789023794.324677:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081728 00000100:00100000:3.0:1789023794.324789:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:3.0:1789023794.324800:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+12:13776:x1875927007081728:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789023794.324816:0:14332:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023794.324833:0:14332:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e65e713c600/0xc3c1fcbfb3419070 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd98 expref: -99 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023794.324861:0:14332:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e65e713c600/0xc3c1fcbfb3419070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd98 expref: 13 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023794.324872:0:14332:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e65e713c600/0xc3c1fcbfb3419070 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd98 expref: 13 pid: 14332 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023794.324881:0:14332:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c600, rc 0) 00000100:00100000:3.0:1789023794.324941:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13776:x1875927007081728:12345-192.168.203.48@tcp:101:ll_cfg_requeue.0 Request processed in 143us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023794.324948:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 114 00000100:00100000:2.0:1789023794.326939:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023794.327013:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081856 00000100:00100000:3.0:1789023794.327023:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081856 00000100:00100000:3.0:1789023794.327074:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:3.0:1789023794.327099:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13776:x1875927007081856:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.327395:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13776:x1875927007081856:12345-192.168.203.48@tcp:501:ll_cfg_requeue.0 Request processed in 298us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023794.327403:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 115 00000100:00100000:2.0:1789023794.335255:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023794.335342:0:14332:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007081984 00000100:00100000:3.0:1789023794.335352:0:14332:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007081984 00000100:00100000:3.0:1789023794.335409:0:14332:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:3.0:1789023794.335419:0:14332:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13776:x1875927007081984:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789023794.335675:0:14332:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:13776:x1875927007081984:12345-192.168.203.48@tcp:503:ll_cfg_requeue.0 Request processed in 256us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023794.335683:0:14332:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 116 00000100:00100000:0.0:1789023794.698842:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024897408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789023794.698924:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023794.699410:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024897408 00000100:00100000:1.0:1789023794.699420:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024897408 00000100:00100000:1.0:1789023794.699513:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789023794.699526:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024897408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789023794.699561:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789023794.699600:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789023794.699615:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024897408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023794.699623:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789023794.699659:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2246300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024897408:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789023794.889872:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023795.533222:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.533318:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007082112 00000100:00100000:3.0:1789023795.533328:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007082112 00000100:00100000:3.0:1789023795.533399:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1789023795.533409:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:14432:x1875927007082112:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023795.533428:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023795.533451:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb3419077 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfd9f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533550:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533565:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533579:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533610:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533619:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533625:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533959:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb341908c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533969:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb341908c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.533976:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb341908c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023795.533996:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789023795.534000:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023795.534033:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb341908c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534043:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534055:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534062:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534078:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023795.534082:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534089:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534101:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:3.0:1789023795.534104:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023795.534108:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534114:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb341907e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534126:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534132:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534138:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534143:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023795.534146:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534153:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534170:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e65c6960900) 00010000:00010000:3.0:1789023795.534173:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023795.534176:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534183:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419085 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534217:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb3419077 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd9f expref: 8 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534231:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c200/0xc3c1fcbfb341908c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd9f expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.534239:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e65c6960600) 00010000:00010000:3.0:1789023795.534242:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789023795.534244:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713c200, rc 0) 00000100:00100000:3.0:1789023795.534308:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:14432:x1875927007082112:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 901us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023795.534316:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00080000:2.0:1789023795.535725:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023795.542844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.544637:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007082368 00000100:00100000:1.0:1789023795.544651:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007082368 00000100:00100000:1.0:1789023795.544721:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789023795.544729:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:14432:x1875927007082368:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023795.544747:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023795.544767:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb3419093 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfda6 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.544836:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.544851:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.544863:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.544940:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.544965:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.544972:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545587:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67200/0xc3c1fcbfb34190a8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545598:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67200/0xc3c1fcbfb34190a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545606:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67200/0xc3c1fcbfb34190a8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023795.545617:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789023795.545811:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545819:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545826:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545832:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023795.545836:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545843:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545866:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e65c6960600) 00010000:00010000:1.0:1789023795.545869:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.545875:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545882:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341909a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545894:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545900:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545916:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545922:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023795.545925:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545930:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545938:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e65eea05d00) 00010000:00010000:1.0:1789023795.545941:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.545943:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.545949:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190a1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.546465:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb3419093 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfda6 expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.546534:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67200/0xc3c1fcbfb34190a8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfda6 expref: 9 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.546542:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65eea05300) 00010000:00010000:1.0:1789023795.546544:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.546547:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f67200, rc 0) 00000100:00100000:1.0:1789023795.546611:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14432:x1875927007082368:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1880us (3845us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789023795.546618:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789023795.552031:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.552116:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007082496 00000100:00100000:3.0:1789023795.552127:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007082496 00000100:00100000:3.0:1789023795.552183:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:3.0:1789023795.552194:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14432:x1875927007082496:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789023795.552401:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14432:x1875927007082496:12345-192.168.203.48@tcp:59:lhsmtool_posix.0 Request processed in 208us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023795.552409:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:2.0:1789023795.586722:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.586892:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007082624 00000100:00100000:1.0:1789023795.586915:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007082624 00000100:00100000:1.0:1789023795.586975:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1789023795.586987:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14438:x1875927007082624:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023795.587007:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023795.587027:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb34190b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdad expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587089:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587103:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587133:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587150:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587158:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587165:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587349:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587358:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587366:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587373:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023795.587377:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587385:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587398:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:1.0:1789023795.587401:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.587406:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587421:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb34190bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587435:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587442:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587448:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587454:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023795.587457:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587586:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587596:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023795.587599:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.587602:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587608:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587643:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb34190b6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdad expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587665:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:1.0:1789023795.587668:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.587673:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb34190b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdad expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.587683:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f67000, rc 0) 00000100:00100000:1.0:1789023795.587808:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14438:x1875927007082624:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 823us (1095us total) trans 0 rc 301/301 00000100:00100000:1.0:1789023795.587816:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:0.0:1789023795.593437:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.594037:0:14349:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007082752 00000100:00100000:3.0:1789023795.594047:0:14349:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007082752 00000100:00100000:3.0:1789023795.594100:0:14349:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:3.0:1789023795.594110:0:14349:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14438:x1875927007082752:12345-192.168.203.48@tcp:700:lfs.0 00000100:00100000:3.0:1789023795.594285:0:14349:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14438:x1875927007082752:12345-192.168.203.48@tcp:700:lfs.0 Request processed in 176us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023795.594293:0:14349:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:1.0:1789023795.597322:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.597401:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007083008 00000100:00100000:3.0:1789023795.597410:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007083008 00000100:00100000:3.0:1789023795.597575:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:3.0:1789023795.597586:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14438:x1875927007083008:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:3.0:1789023795.597638:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023795.597662:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb3418ff9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd28 expref: 9 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.597679:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:3.0:1789023795.597684:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023795.597928:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.597941:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 5 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.597949:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.597982:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 5 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.598008:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 5 pid: 14342 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023795.598023:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875927024897536:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023795.598106:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789023795.601176:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023795.601242:0:16455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007083136 00000100:00100000:0.0:1789023795.601251:0:16455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007083136 00010000:00010000:0.0:1789023795.601302:0:16455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 6 pid: 14342 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023795.601339:0:16455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789023795.601348:0:16455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:2364:x1875927007083136:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789023795.601380:0:16455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023795.601386:0:16455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 6 pid: 14342 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.601398:0:16455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 6 pid: 14342 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.601416:0:16455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:0.0:1789023795.601421:0:16455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.601429:0:16455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.601435:0:16455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.601451:0:16455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023795.601528:0:16455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:2364:x1875927007083136:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 181us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023795.601535:0:16455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00080000:2.0:1789023795.601697:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789023795.602131:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419031 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfd8a expref: 5 pid: 14342 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023795.602147:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875927024897536:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023795.602168:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.602177:0:14340:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.602183:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.602205:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.602216:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.602224:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023795.603561:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789023795.603581:0:14340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.603589:0:14340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.603596:0:14340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.603602:0:14340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023795.603605:0:14340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.603612:0:14340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.603624:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65d7dc7c00) 00010000:00010000:3.0:1789023795.603627:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023795.603631:0:14340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.603636:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190cb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789023795.603654:0:14340:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000afbed1b reply state 00000000a0ea7c87 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023795.603662:0:14340:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789023795.603752:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2246a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+10:14438:x1875927007083008:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 6167us (6435us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789023795.603760:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00010000:00010000:0.0:1789023795.606614:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.606630:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.606637:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.606659:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713cc00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023795.606663:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.606671:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.606686:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e65c6960900) 00010000:00010000:0.0:1789023795.606689:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023795.606694:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023795.606700:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb34190d2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023795.708215:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023795.708319:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007083264 00000100:00100000:2.0:1789023795.708329:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007083264 00000100:00100000:2.0:1789023795.708385:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1789023795.708394:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:14446:x1875927007083264:12345-192.168.203.48@tcp:101:lctl.0 00010000:00010000:2.0:1789023795.708416:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023795.708435:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34190d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdb4 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.708551:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34190e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.708564:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34190e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.708575:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34190e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023795.708609:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023795.708612:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023795.708648:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34190e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.708671:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34190d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdb4 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.708690:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07c00/0xc3c1fcbfb34190e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdb4 expref: 10 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.708697:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023795.708700:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789023795.708703:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07c00, rc 0) 00000100:00100000:2.0:1789023795.708769:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+10:14446:x1875927007083264:12345-192.168.203.48@tcp:101:lctl.0 Request processed in 376us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023795.708776:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 20 00000100:00100000:2.0:1789023795.736809:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.736876:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007083392 00000100:00100000:3.0:1789023795.736910:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007083392 00000100:00100000:3.0:1789023795.736972:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:3.0:1789023795.736983:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:14448:x1875927007083392:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023795.737003:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023795.737021:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdbb expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.737080:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34190ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.737093:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34190ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.737104:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34190ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023795.737138:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789023795.737141:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023795.737158:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34190ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.737179:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34190e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdbb expref: 7 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.737196:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d000/0xc3c1fcbfb34190ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdbb expref: 6 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.737203:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:3.0:1789023795.737206:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789023795.737208:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d000, rc 0) 00000100:00100000:3.0:1789023795.737278:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:14448:x1875927007083392:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 297us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023795.737286:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 21 00000100:00100000:0.0:1789023795.741822:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.741890:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007083520 00000100:00100000:1.0:1789023795.741912:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007083520 00000100:00100000:1.0:1789023795.741980:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:1.0:1789023795.741991:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+6:14448:x1875927007083520:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023795.742012:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023795.742033:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb34190f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdc2 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742083:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742093:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742101:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742129:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742136:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742142:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742217:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341910a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742223:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341910a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742227:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341910a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023795.742250:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789023795.742253:0:14342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023795.742267:0:14342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341910a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742275:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742280:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742285:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742296:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023795.742299:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742304:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742312:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:1.0:1789023795.742314:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.742318:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742322:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb34190fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742331:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742334:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742357:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742360:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023795.742362:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742365:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742376:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e65eea05d00) 00010000:00010000:1.0:1789023795.742378:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.742379:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742383:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419103 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742406:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb34190f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdc2 expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742413:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341910a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdc2 expref: 7 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.742418:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023795.742419:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789023795.742421:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f66200, rc 0) 00000100:00100000:1.0:1789023795.742616:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+7:14448:x1875927007083520:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 626us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023795.742623:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 22 00000100:00100000:0.0:1789023795.747283:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023795.747516:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007083776 00000100:00100000:2.0:1789023795.747539:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007083776 00000100:00100000:2.0:1789023795.747712:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789023795.748226:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+7:14448:x1875927007083776:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023795.748249:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023795.748271:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3419111 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdc9 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023795.748362:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789023795.750613:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3419111 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdc9 expref: 9 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.750633:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023795.750636:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023795.750641:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb3419111 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdc9 expref: 9 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.750658:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07e00, rc 0) 00000100:00100000:2.0:1789023795.751158:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+8:14448:x1875927007083776:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 3435us (3883us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789023795.751167:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 23 00000100:00100000:2.0:1789023795.757157:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.757436:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007084032 00000100:00100000:1.0:1789023795.757448:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007084032 00000100:00100000:1.0:1789023795.757539:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:1.0:1789023795.757550:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+8:14448:x1875927007084032:12345-192.168.203.48@tcp:36:lfs.0 00010000:00010000:1.0:1789023795.757605:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023795.757630:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341910a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdc2 expref: 8 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.757665:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65eea05900) 00010000:00010000:1.0:1789023795.757676:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789023795.757698:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.757710:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.757719:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023795.757946:0:14342:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024af8168 reply state 000000004a736ff9 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023795.757956:0:14342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789023795.757964:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789023795.758034:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+9:14448:x1875927007084032:12345-192.168.203.48@tcp:36:lfs.0 Request processed in 486us (887us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789023795.758041:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 24 00000100:00100000:0.0:1789023795.760532:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:3.0:1789023795.760662:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.760673:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.760680:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.760686:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67000 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023795.760690:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.760698:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.760712:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65eea05d00) 00010000:00010000:3.0:1789023795.760715:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1789023795.760719:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.760725:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67000/0xc3c1fcbfb341911f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023795.761388:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007084288 00000100:00100000:1.0:1789023795.761399:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007084288 00000100:00100000:1.0:1789023795.761521:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:1.0:1789023795.761532:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+8:14448:x1875927007084288:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023795.761742:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+9:14448:x1875927007084288:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 212us (1217us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789023795.761749:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789023795.764742:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023795.764867:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007084544 00000100:00100000:2.0:1789023795.764877:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007084544 00000100:00100000:2.0:1789023795.764938:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1789023795.764948:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+9:14448:x1875927007084544:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:2.0:1789023795.764971:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023795.764995:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3419126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdd0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765274:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765288:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765300:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765314:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765321:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765327:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023795.765439:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789023795.765680:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765686:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765690:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765694:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023795.765697:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765709:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765718:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023795.765720:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023795.765723:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765727:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb341912d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765737:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765740:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765744:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765747:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07a00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023795.765748:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765751:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765755:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023795.765756:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023795.765757:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765766:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419134 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765850:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3419126 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd0 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765860:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023795.765862:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789023795.765866:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb3419126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd0 expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.765877:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d06a00, rc 0) 00000100:00100000:2.0:1789023795.765993:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+10:14448:x1875927007084544:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 1046us (1258us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789023795.765999:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 25 00000100:00100000:2.0:1789023795.768720:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.768798:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007084672 00000100:00100000:3.0:1789023795.768807:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007084672 00000100:00100000:3.0:1789023795.768874:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:3.0:1789023795.768884:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+10:14448:x1875927007084672:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023795.768930:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023795.768951:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb3419142 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdd7 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.769029:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.769042:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.769053:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023795.769076:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789023795.769080:0:14340:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789023795.769094:0:14340:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.769118:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb3419142 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 12 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.769134:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.769142:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65c6960700) 00010000:00010000:3.0:1789023795.769145:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789023795.769150:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d200, rc 0) 00000100:00100000:3.0:1789023795.769197:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+11:14448:x1875927007084672:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 314us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023795.769212:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 26 00000100:00100000:0.0:1789023795.773291:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.773371:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007084800 00000100:00100000:3.0:1789023795.773381:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007084800 00000100:00100000:3.0:1789023795.773434:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:3.0:1789023795.773443:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+11:14448:x1875927007084800:12345-192.168.203.48@tcp:37:lfs.0 00000100:00100000:3.0:1789023795.782992:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+11:14448:x1875927007084800:12345-192.168.203.48@tcp:37:lfs.0 Request processed in 9540us (9701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023795.783004:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:2.0:1789023795.794557:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.794692:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007085056 00000100:00100000:1.0:1789023795.794712:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007085056 00000100:00100000:1.0:1789023795.794758:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:1.0:1789023795.794767:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65fcb62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+11:14448:x1875927007085056:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023795.794984:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65fcb62c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+12:14448:x1875927007085056:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 218us (436us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789023795.794991:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:0.0:1789023795.858032:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023795.858121:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007085184 00000100:00100000:2.0:1789023795.858130:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007085184 00000100:00100000:2.0:1789023795.858187:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:2.0:1789023795.858196:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+10:14454:x1875927007085184:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:2.0:1789023795.858216:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023795.858235:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdde expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858298:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858323:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858334:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858348:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858355:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858361:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858451:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3419165 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858723:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3419165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.858733:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3419165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023795.858762:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789023795.858766:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789023795.859004:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3419165 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859017:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859036:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859043:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859049:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07400 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023795.859054:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859063:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859075:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:2.0:1789023795.859079:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023795.859084:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859090:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb3419157 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859106:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859113:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859119:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859124:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023795.859133:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859140:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859149:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023795.859151:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023795.859154:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859160:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb341915e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859196:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdde expref: 12 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859211:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07600/0xc3c1fcbfb3419165 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdde expref: 11 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.859218:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65c6960700) 00010000:00010000:2.0:1789023795.859220:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789023795.859223:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07600, rc 0) 00000100:00100000:2.0:1789023795.859333:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+11:14454:x1875927007085184:12345-192.168.203.48@tcp:101:bash.0 Request processed in 1138us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023795.859341:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 27 00000100:00100000:0.0:1789023795.863632:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.863870:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007085440 00000100:00100000:1.0:1789023795.863879:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007085440 00000100:00100000:1.0:1789023795.863952:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 28 00000100:00100000:1.0:1789023795.863962:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+11:14454:x1875927007085440:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023795.863983:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023795.864002:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341916c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfde5 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.864104:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.864118:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.864125:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.864155:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 11 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.864167:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 11 pid: 14340 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023795.864197:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14342:1875927024897664:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023795.864283:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2965840 going to sleep for 11 seconds 00000100:00100000:0.0:1789023795.868865:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023795.869122:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007085568 00000100:00100000:3.0:1789023795.869132:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007085568 00010000:00010000:3.0:1789023795.869179:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 12 pid: 14340 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023795.869217:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1789023795.869226:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+12:2362:x1875927007085568:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023795.869241:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023795.869250:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 12 pid: 14340 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.869262:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 12 pid: 14340 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.869282:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65c6960700) 00010000:00010000:3.0:1789023795.869288:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.869315:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.869322:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023795.869341:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023795.869400:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bbc2932e-2ebc-4490-aab0-35e306ea0896+12:2362:x1875927007085568:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 175us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023795.869408:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00010000:00010000:1.0:1789023795.870167:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb3419149 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdd7 expref: 11 pid: 14340 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023795.870187:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14342:1875927024897664:192.168.203.48@tcp:104: 00010000:00010000:1.0:1789023795.870206:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.870216:0:14342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.870222:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.870245:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.870255:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.870264:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873823:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873851:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873877:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023795.873890:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789023795.873934:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873941:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873948:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873953:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023795.873957:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873964:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873975:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65c6960700) 00010000:00010000:1.0:1789023795.873978:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023795.873982:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.873988:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419173 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789023795.874001:0:14342:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed4e33ca reply state 00000000db466035 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023795.874020:0:14342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789023795.874058:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341916c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 14 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.874073:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 13 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.874080:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023795.874082:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1789023795.874084:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f66e00, rc 0) 00000100:00100000:1.0:1789023795.874170:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+14:14454:x1875927007085440:12345-192.168.203.48@tcp:101:bash.0 Request processed in 10208us (10546us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1789023795.874178:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 28 00010000:00010000:2.0:1789023795.877017:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.877035:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.877057:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.877063:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023795.877068:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.877076:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.877093:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e65eea05900) 00010000:00010000:2.0:1789023795.877096:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789023795.877100:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023795.877106:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341917a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023795.892214:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.892411:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007085696 00000100:00100000:1.0:1789023795.892432:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007085696 00000100:00100000:1.0:1789023795.892564:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:1.0:1789023795.892592:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+13:14454:x1875927007085696:12345-192.168.203.48@tcp:101:bash.0 00010000:00010000:1.0:1789023795.892628:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023795.892658:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341918f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdec expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.892735:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.892761:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.892810:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023795.892876:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789023795.892895:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023795.892938:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.892949:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.892974:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341918f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.892992:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 14 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023795.893000:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023795.893003:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789023795.893006:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f66c00, rc 0) 00000100:00100000:1.0:1789023795.893058:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+14:14454:x1875927007085696:12345-192.168.203.48@tcp:101:bash.0 Request processed in 485us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023795.893065:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 29 00000100:00100000:0.0:1789023795.897925:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023795.897969:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007085952 00000100:00100000:1.0:1789023795.897979:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007085952 00000100:00100000:1.0:1789023795.898032:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:1.0:1789023795.898042:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+14:14454:x1875927007085952:12345-192.168.203.48@tcp:35:bash.0 00000100:00100000:1.0:1789023795.898373:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+15:14454:x1875927007085952:12345-192.168.203.48@tcp:35:bash.0 Request processed in 331us (473us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789023795.898393:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00010000:00010000:0.0:1789023795.915217:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789023796.005108:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023796.005209:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007086208 00000100:00100000:1.0:1789023796.005219:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007086208 00000100:00100000:1.0:1789023796.005322:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:1.0:1789023796.005332:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+15:14464:x1875927007086208:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:1.0:1789023796.005356:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023796.005374:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341919d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdf3 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023796.005567:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789023796.005678:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341919d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdf3 expref: 17 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.005693:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e65f41d1700) 00010000:00010000:1.0:1789023796.005696:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789023796.005701:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb341919d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdf3 expref: 17 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.005714:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f66200, rc 0) 00000100:00100000:1.0:1789023796.005760:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+16:14464:x1875927007086208:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 431us (663us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789023796.005777:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 30 00000100:00100000:2.0:1789023796.010541:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023796.010630:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007086464 00000100:00100000:1.0:1789023796.010640:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007086464 00000100:00100000:1.0:1789023796.010693:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:1.0:1789023796.010703:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+16:14464:x1875927007086464:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023796.010984:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+17:14464:x1875927007086464:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 282us (451us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789023796.010993:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:0.0:1789023796.055395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023796.055518:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007086720 00000100:00100000:3.0:1789023796.055529:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007086720 00000100:00100000:3.0:1789023796.055586:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:3.0:1789023796.055596:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+17:14467:x1875927007086720:12345-192.168.203.48@tcp:101:lfs.0 00010000:00010000:3.0:1789023796.055619:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023796.055637:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34191ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfdfa expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.055726:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.055751:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.055764:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789023796.055782:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789023796.055896:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34191ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdfa expref: 20 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.055932:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdfa expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.055941:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:3.0:1789023796.055944:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789023796.055948:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d600, rc 0) 00000100:00100000:3.0:1789023796.055998:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+19:14467:x1875927007086720:12345-192.168.203.48@tcp:101:lfs.0 Request processed in 403us (808us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789023796.056005:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 31 00000100:00100000:0.0:1789023796.059094:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023796.059135:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023796.060168:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007086848 00000100:00100000:1.0:1789023796.060179:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007086848 00000100:00100000:1.0:1789023796.060377:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:1.0:1789023796.060387:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+19:14467:x1875927007086848:12345-192.168.203.48@tcp:54:lfs.0 00010000:00010000:1.0:1789023796.060463:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060512:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060525:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060551:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060558:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060565:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060571:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023796.060575:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060582:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060607:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023796.060610:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789023796.060615:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.060622:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023796.060686:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+19:14467:x1875927007086848:12345-192.168.203.48@tcp:54:lfs.0 Request processed in 301us (1600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023796.060693:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 32 00000100:00100000:2.0:1789023796.060973:0:16455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007086976 00000100:00100000:2.0:1789023796.060978:0:16455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007086976 00000100:00100000:2.0:1789023796.061023:0:16455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1789023796.061031:0:16455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+19:2363:x1875927007086976:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023796.061042:0:16455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023796.061058:0:16455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdfa expref: 19 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.061082:0:16455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:2.0:1789023796.061085:0:16455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023796.061105:0:16455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+18:2363:x1875927007086976:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 75us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023796.061111:0:16455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1789023796.063748:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023796.063889:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007087232 00000100:00100000:1.0:1789023796.063908:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007087232 00000100:00100000:1.0:1789023796.063962:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:1.0:1789023796.063972:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+18:14467:x1875927007087232:12345-192.168.203.48@tcp:35:lfs.0 00000100:00100000:1.0:1789023796.064188:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7314000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+19:14467:x1875927007087232:12345-192.168.203.48@tcp:35:lfs.0 Request processed in 218us (448us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789023796.064205:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789023796.357921:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023796.358917:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007087488 00000100:00100000:2.0:1789023796.358930:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007087488 00000100:00100000:2.0:1789023796.359115:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:2.0:1789023796.359127:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+19:14498:x1875927007087488:12345-192.168.203.48@tcp:101:cat.0 00010000:00010000:2.0:1789023796.360096:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023796.360119:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34191c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe01 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.360230:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb34191ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.360244:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb34191ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.360255:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb34191ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789023796.360265:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789023796.360421:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07400/0xc3c1fcbfb34191c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe01 expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.360440:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb34191ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe01 expref: 21 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.360461:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:2.0:1789023796.360464:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023796.360467:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07200, rc 0) 00000100:00100000:2.0:1789023796.360569:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:14498:x1875927007087488:12345-192.168.203.48@tcp:101:cat.0 Request processed in 1444us (2657us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789023796.360577:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 33 00000100:00100000:0.0:1789023796.365186:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023796.365233:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023796.365252:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007087872 00000100:00100000:3.0:1789023796.365263:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007087872 00000100:00100000:3.0:1789023796.365324:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 8 00000100:00100000:3.0:1789023796.365336:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:14498:x1875927007087872:12345-192.168.203.48@tcp:35:cat.0 00000100:00100000:1.0:1789023796.365373:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007087616 00000100:00100000:1.0:1789023796.365378:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007087616 00000100:00100000:1.0:1789023796.365416:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:1.0:1789023796.365424:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+22:2363:x1875927007087616:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789023796.365435:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789023796.365457:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07200/0xc3c1fcbfb34191ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe01 expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.365523:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023796.365528:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789023796.365577:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+22:2363:x1875927007087616:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 152us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023796.365586:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:3.0:1789023796.365686:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7315180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:14498:x1875927007087872:12345-192.168.203.48@tcp:35:cat.0 Request processed in 352us (508us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789023796.365694:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 8 00000040:00080000:3.0:1789023796.426246:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789023796.460359:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023796.460447:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007088128 00000100:00100000:3.0:1789023796.460470:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007088128 00000100:00100000:3.0:1789023796.460552:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:3.0:1789023796.460563:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:14504:x1875927007088128:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:3.0:1789023796.460589:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023796.460609:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34191dc lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe08 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.460724:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.460739:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 22 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.460748:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.460792:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.460826:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 22 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.460840:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 22 pid: 14341 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023796.460854:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875927024897792:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023796.460968:0:14340:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 22 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.460978:0:14340:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 22 pid: 14342 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023796.460988:0:14340:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875927024897920:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023796.461021:0:14340:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789023796.464548:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875927024897792:192.168.203.48@tcp:104: 00000100:00100000:0.0:1789023796.464749:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023796.464959:0:16455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007088256 00000100:00100000:2.0:1789023796.464966:0:16455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007088256 00010000:00010000:2.0:1789023796.465060:0:16455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 23 pid: 14341 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023796.465102:0:16455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789023796.465113:0:16455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c191f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+23:2361:x1875927007088256:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023796.465128:0:16455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023796.465135:0:16455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 23 pid: 14341 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.465257:0:16455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 23 pid: 14341 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.465279:0:16455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419196 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfdec expref: 23 pid: 14341 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.465295:0:16455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:2.0:1789023796.465301:0:16455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023796.465321:0:14340:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14340:1875927024897920:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023796.465324:0:16455:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.465335:0:16455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023796.465348:0:14340:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023796.465391:0:16455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c191f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+22:2361:x1875927007088256:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 280us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023796.465400:0:16455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:0.0:1789023796.466563:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023796.466679:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007088384 00000100:00100000:3.0:1789023796.466687:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007088384 00010000:00010000:3.0:1789023796.466714:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 22 pid: 14342 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023796.466748:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:3.0:1789023796.466758:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+22:2362:x1875927007088384:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023796.466874:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023796.466881:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 22 pid: 14342 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.466893:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 22 pid: 14342 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.466920:0:14325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb3419181 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfde5 expref: 22 pid: 14342 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.467287:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:3.0:1789023796.467294:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.467319:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.467326:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.467400:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023796.467465:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:2362:x1875927007088384:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 698us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023796.467473:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00010000:00010000:0.0:1789023796.470006:0:14340:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023796.470023:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789023796.470046:0:14340:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789023796.470232:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713c400/0xc3c1fcbfb34191dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe08 expref: 22 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023796.470254:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d600/0xc3c1fcbfb34191e3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe08 expref: 21 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023796.470263:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:0.0:1789023796.470266:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789023796.470269:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d600, rc 0) 00000100:00100000:0.0:1789023796.470338:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcdce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:14504:x1875927007088128:12345-192.168.203.48@tcp:101:dd.0 Request processed in 9776us (9989us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789023796.470345:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 34 00000100:00100000:0.0:1789023796.475623:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023796.476730:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007088640 00000100:00100000:2.0:1789023796.476743:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007088640 00000100:00100000:2.0:1789023796.476861:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 35 00000100:00100000:2.0:1789023796.476874:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:14504:x1875927007088640:12345-192.168.203.48@tcp:36:dd.0 00010000:00010000:2.0:1789023796.477160:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.477175:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023796.477186:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789023796.477234:0:14341:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789023796.477281:0:14341:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d978b6a2 reply state 0000000002480401 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023796.477289:0:14341:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023796.477406:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65ffcded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14504:x1875927007088640:12345-192.168.203.48@tcp:36:dd.0 Request processed in 535us (1792us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789023796.477414:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 35 00000020:00080000:2.0:1789023796.477419:0:14341:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789023796.481073:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.481207:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.481217:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.481222:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:3.0:1789023796.481227:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.481247:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.481264:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:3.0:1789023796.481267:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789023796.481272:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.481294:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34191f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023796.481968:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023796.482053:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007088768 00000100:00100000:3.0:1789023796.482106:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007088768 00000100:00100000:3.0:1789023796.482188:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:3.0:1789023796.482197:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f7981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+23:14504:x1875927007088768:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:3.0:1789023796.482217:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023796.482233:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34191f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe0f expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.482299:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34191f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe0f expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.482312:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34191f8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe0f expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.482338:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:3.0:1789023796.482341:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789023796.482350:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d200, rc 0) 00000100:00100000:3.0:1789023796.482653:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f7981880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14504:x1875927007088768:12345-192.168.203.48@tcp:101:dd.0 Request processed in 456us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023796.482662:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 36 00000100:00100000:2.0:1789023796.510201:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023796.510374:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089024 00000100:00100000:0.0:1789023796.510383:0:14326:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089024 00000100:00100000:0.0:1789023796.510451:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789023796.510462:0:14326:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14504:x1875927007089024:12345-192.168.203.48@tcp:103:dd.0 00010000:00010000:0.0:1789023796.510607:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023796.510633:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb34191f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe0f expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023796.510652:0:14326:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:0.0:1789023796.510657:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789023796.510718:0:14326:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c95180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+23:14504:x1875927007089024:12345-192.168.203.48@tcp:103:dd.0 Request processed in 258us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023796.510726:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789023796.516093:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023796.516183:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089152 00000100:00100000:1.0:1789023796.516193:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089152 00000100:00100000:1.0:1789023796.516259:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:1.0:1789023796.516269:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+23:14504:x1875927007089152:12345-192.168.203.48@tcp:58:dd.0 00010000:00010000:1.0:1789023796.516383:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.516401:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023796.516413:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789023796.517191:0:14341:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789023796.517345:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789023796.517417:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789023796.517546:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+23:14504:x1875927007089152:12345-192.168.203.48@tcp:58:dd.0 Request processed in 1277us (1461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023796.517556:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 37 00000100:00100000:2.0:1789023796.520987:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023796.521072:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089280 00000100:00100000:3.0:1789023796.521081:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089280 00000100:00100000:3.0:1789023796.521133:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 38 00000100:00100000:3.0:1789023796.521144:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65f6c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+23:14504:x1875927007089280:12345-192.168.203.48@tcp:101:dd.0 00010000:00010000:3.0:1789023796.521177:0:14340:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023796.521196:0:14340:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe16 expref: -99 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.521246:0:14340:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.521256:0:14340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe16 expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.521274:0:14340:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.521286:0:14340:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe16 expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.521299:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:3.0:1789023796.521302:0:14340:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789023796.521305:0:14340:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe16 expref: 24 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023796.521313:0:14340:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713cc00, rc 0) 00000100:00100000:3.0:1789023796.521370:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65f6c94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14504:x1875927007089280:12345-192.168.203.48@tcp:101:dd.0 Request processed in 227us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023796.521376:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 38 00010000:00010000:0.0:1789023796.937713:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023797.241072:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.241172:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.241206:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.241258:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089792 00000100:00100000:1.0:1789023797.241268:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089792 00000100:00100000:1.0:1789023797.241348:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00080000:3.0:1789023797.241350:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789023797.241361:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+11:2364:x1875927007089792:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023797.241468:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+11:2364:x1875927007089792:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.241516:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 19 00000100:00100000:2.0:1789023797.247887:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.248107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.248215:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089408 00000100:00100000:1.0:1789023797.248225:0:14334:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089408 00000100:00100000:0.0:1789023797.248228:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089536 00000100:00100000:0.0:1789023797.248235:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089536 00000100:00100000:3.0:1789023797.248237:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007090048 00000100:00100000:3.0:1789023797.248244:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007090048 00000100:00100000:1.0:1789023797.248283:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:1.0:1789023797.248295:0:14334:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:2364:x1875927007089408:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:3.0:1789023797.248297:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089664 00000100:00100000:3.0:1789023797.248304:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089664 00000100:00100000:3.0:1789023797.248326:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1789023797.248347:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007090048:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:1.0:1789023797.248367:0:14334:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:46ea25f4-7df3-498a-85ac-3ccb91540e61+13:2364:x1875927007089408:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 74us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.248376:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 117 00000100:00100000:3.0:1789023797.248385:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7316300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007090048:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 50us (7177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.248393:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:3.0:1789023797.248412:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:2.0:1789023797.248421:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.248425:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007089664:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023797.248450:0:15022:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789023797.248460:0:15022:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789023797.248576:0:15024:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789023797.248583:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007089920 00000100:00100000:0.0:1789023797.248587:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007089920 00000100:00100000:0.0:1789023797.248607:0:15024:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789023797.248614:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1789023797.248621:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c18ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007089536:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023797.248662:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c18ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007089536:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 41us (7600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023797.248670:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:0.0:1789023797.248692:0:15024:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1789023797.248699:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:0.0:1789023797.248706:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007089920:12345-192.168.203.48@tcp:400:kworker.0 00000100:00100000:0.0:1789023797.248733:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:bbc2932e-2ebc-4490-aab0-35e306ea0896+5:2364:x1875927007089920:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023797.248739:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00080000:2.0:1789023797.249092:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789023797.249097:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789023797.249974:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e7317100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007089664:12345-192.168.203.48@tcp:400:kworker.0 Request processed in 1551us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.249983:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00000040:00080000:3.0:1789023797.449730:0:14373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789023797.449741:0:14373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789023797.449775:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789023797.449783:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789023797.449904:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14373:1875927024898048:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789023797.450009:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65e7322480 going to sleep for 11 seconds 00000100:00100000:3.0:1789023797.454198:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14373:1875927024898048:192.168.203.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789023797.459559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023797.460310:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007090176 00000100:00100000:0.0:1789023797.460321:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007090176 00000100:00100000:0.0:1789023797.460404:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:0.0:1789023797.460415:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14505:x1875927007090176:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789023797.460515:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14505:x1875927007090176:12345-192.168.203.48@tcp:900:lhsmtool_posix.0 Request processed in 103us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023797.460523:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00080000:2.0:1789023797.460593:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789023797.466837:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.466905:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007090304 00000100:00100000:1.0:1789023797.466915:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007090304 00000100:00100000:1.0:1789023797.466963:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:1.0:1789023797.466970:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14505:x1875927007090304:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789023797.467008:0:14341:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789023797.467101:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14505:x1875927007090304:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 131us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.467107:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 39 00000100:00100000:3.0:1789023797.474804:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.475094:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007090432 00000100:00100000:1.0:1789023797.475104:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007090432 00000100:00100000:1.0:1789023797.475160:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:1.0:1789023797.475169:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14505:x1875927007090432:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789023797.475239:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475265:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475292:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475873:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475883:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475901:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475923:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475930:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475936:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023797.475971:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789023797.475975:0:14342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023797.475986:0:14342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.475997:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476003:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476021:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476028:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.476033:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476042:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476059:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65eea05300) 00010000:00010000:1.0:1789023797.476062:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023797.476067:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476073:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341920d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476086:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476092:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476098:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476103:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.476105:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476120:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476128:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e65eea05e00) 00010000:00010000:1.0:1789023797.476130:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023797.476133:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476138:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419214 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476153:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476158:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476163:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476168:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.476170:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476175:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476181:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023797.476183:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023797.476185:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.476198:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341921b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.476882:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14505:x1875927007090432:12345-192.168.203.48@tcp:34:lhsmtool_posix.0 Request processed in 1710us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.476903:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 40 00000100:00100000:2.0:1789023797.486882:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.486985:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007090688 00000100:00100000:1.0:1789023797.486996:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007090688 00000100:00100000:1.0:1789023797.487057:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:1.0:1789023797.487067:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+24:14505:x1875927007090688:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023797.487087:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023797.487105:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb3419222 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe1d expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487198:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487214:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487226:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023797.487238:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789023797.487331:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487338:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487361:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487367:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66c00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.487371:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487378:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487388:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023797.487392:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789023797.487396:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487402:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419229 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487442:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb3419222 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe1d expref: 26 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487464:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e65eea05300) 00010000:00010000:1.0:1789023797.487467:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789023797.487472:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb3419222 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe1d expref: 26 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.487846:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f67c00, rc 0) 00000100:00100000:1.0:1789023797.487919:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+25:14505:x1875927007090688:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 853us (1046us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1789023797.487935:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 41 00000100:00100000:0.0:1789023797.497256:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.497584:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007090816 00000100:00100000:1.0:1789023797.497594:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007090816 00000100:00100000:1.0:1789023797.497682:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:1.0:1789023797.497694:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+25:14505:x1875927007090816:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789023797.497726:0:14342:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789023797.497840:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+25:14505:x1875927007090816:12345-192.168.203.48@tcp:53:lhsmtool_posix.0 Request processed in 148us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.497847:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 42 00000100:00100000:2.0:1789023797.501727:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.501938:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007091072 00000100:00100000:3.0:1789023797.501949:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007091072 00000100:00100000:3.0:1789023797.502073:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:3.0:1789023797.502085:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+25:14505:x1875927007091072:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023797.502106:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023797.502139:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d800/0xc3c1fcbfb3419237 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe24 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789023797.504994:0:14341:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:3.0:1789023797.505005:0:14341:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789023797.507205:0:14341:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789023797.508186:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341923e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.508204:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341923e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.508217:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341923e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.508277:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d800/0xc3c1fcbfb3419237 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe24 expref: 28 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.508296:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341923e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe24 expref: 27 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.508312:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:2.0:1789023797.508315:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789023797.508319:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07800, rc 0) 00000100:00100000:2.0:1789023797.508389:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+27:14505:x1875927007091072:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 6305us (6670us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789023797.508398:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 43 00000100:00100000:2.0:1789023797.511825:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.511900:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007091328 00000100:00100000:1.0:1789023797.511909:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007091328 00000100:00100000:0.0:1789023797.512051:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1789023797.512063:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+27:14505:x1875927007091328:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789023797.512117:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789023797.512143:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb341923e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe24 expref: 27 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512163:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1300) 00010000:00010000:0.0:1789023797.512174:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789023797.512193:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512205:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512227:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512265:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512273:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512280:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512337:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512345:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512351:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512357:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d05e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023797.512361:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512368:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512377:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e65c6960700) 00010000:00010000:0.0:1789023797.512379:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023797.512383:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512394:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d05e00/0xc3c1fcbfb341924c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512408:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512413:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512419:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512423:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:0.0:1789023797.512426:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512432:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512439:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x475dd142 (ffff8e65d7dc7000) 00010000:00010000:0.0:1789023797.512442:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789023797.512445:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.512451:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419253 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x475dd142 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023797.512760:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+26:14505:x1875927007091328:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 699us (942us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789023797.512768:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 44 00000100:00100000:0.0:1789023797.521931:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.521989:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007091456 00000100:00100000:2.0:1789023797.521999:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007091456 00000100:00100000:2.0:1789023797.522065:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1789023797.522075:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+26:14505:x1875927007091456:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789023797.522094:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789023797.522115:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341925a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe2b expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.522148:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419261 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.522161:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.522172:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419261 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.522283:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d06a00/0xc3c1fcbfb341925a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe2b expref: 28 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.522314:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07a00/0xc3c1fcbfb3419261 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe2b expref: 27 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.522322:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:2.0:1789023797.522325:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789023797.522328:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65f6d07a00, rc 0) 00000100:00100000:2.0:1789023797.522385:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+27:14505:x1875927007091456:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 311us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023797.522392:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 45 00000100:00100000:2.0:1789023797.525749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023797.525840:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007091712 00000100:00100000:0.0:1789023797.525849:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007091712 00000100:00100000:0.0:1789023797.525909:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 46 00000100:00100000:0.0:1789023797.525920:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+27:14505:x1875927007091712:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789023797.525994:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.526019:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.526031:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789023797.526645:0:14342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789023797.526655:0:14342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 463597176837ns, next at 464597174893ns, rc = 0 00000004:00010000:0.0:1789023797.526734:0:14342:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000846ebd20 reply state 000000005742d8ef transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023797.526744:0:14342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789023797.526882:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+29:14505:x1875927007091712:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 962us (1141us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789023797.526898:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 46 00010000:00010000:2.0:1789023797.528457:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.528470:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.528505:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.528520:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04600 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:2.0:1789023797.528525:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.528533:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.528548:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:2.0:1789023797.528551:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789023797.528570:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.528577:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65c8d04600/0xc3c1fcbfb3419268 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023797.534189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.536943:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007091840 00000100:00100000:1.0:1789023797.536957:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007091840 00000100:00100000:1.0:1789023797.537138:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:1.0:1789023797.537150:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+28:14505:x1875927007091840:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023797.537175:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023797.537195:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe32 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.537256:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 29 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.537271:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 29 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.537291:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:1.0:1789023797.537308:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023797.537312:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f67c00, rc 0) 00000100:00100000:1.0:1789023797.537378:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+29:14505:x1875927007091840:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 231us (3198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.538166:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 47 00000100:00100000:3.0:1789023797.539878:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.539928:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007091968 00000100:00100000:2.0:1789023797.539937:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007091968 00000100:00100000:2.0:1789023797.539992:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1789023797.540002:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2363:x1875927007091968:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789023797.540817:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2363:x1875927007091968:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 806us (935us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789023797.540825:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 12 00000100:00100000:2.0:1789023797.545583:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.545810:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007092224 00000100:00100000:3.0:1789023797.545821:0:14344:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007092224 00000100:00100000:0.0:1789023797.545965:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:0.0:1789023797.545977:0:14344:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+29:14505:x1875927007092224:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789023797.546207:0:14344:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+30:14505:x1875927007092224:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 232us (631us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1789023797.546215:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 9 00000100:00100000:3.0:1789023797.549265:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023797.549362:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007092480 00000100:00100000:0.0:1789023797.549372:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007092480 00000100:00100000:0.0:1789023797.549756:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:0.0:1789023797.549773:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+30:14505:x1875927007092480:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789023797.550309:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+30:14505:x1875927007092480:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 535us (1051us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023797.550317:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 48 00000100:00100000:3.0:1789023797.553532:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.553748:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007092608 00000100:00100000:1.0:1789023797.553768:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007092608 00000100:00100000:1.0:1789023797.553852:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:1.0:1789023797.553863:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+30:14505:x1875927007092608:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023797.553883:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023797.553911:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419276 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe39 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.554005:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341927d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.554019:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341927d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.554031:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341927d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789023797.554968:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789023797.554993:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341927d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.555024:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66c00/0xc3c1fcbfb3419276 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe39 expref: 32 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.555041:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341927d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe39 expref: 31 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.555130:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:1.0:1789023797.555133:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789023797.555136:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f66e00, rc 0) 00000100:00100000:1.0:1789023797.555236:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+31:14505:x1875927007092608:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 1375us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.555243:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 49 00000100:00100000:2.0:1789023797.559319:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023797.559417:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007092736 00000100:00100000:0.0:1789023797.559426:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007092736 00000100:00100000:3.0:1789023797.559677:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1789023797.559689:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2362:x1875927007092736:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789023797.559707:0:15023:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789023797.559726:0:15023:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe40 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789023797.559752:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa25635, blocks: 0x1 00010000:00010000:3.0:1789023797.559779:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:3.0:1789023797.559784:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023797.559793:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 7 pid: 15023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.559812:0:15023:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 7 pid: 15023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.559826:0:15023:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e65e713d800, rc 0) 00000100:00100000:3.0:1789023797.559885:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:2362:x1875927007092736:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 199us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.559913:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1789023797.563856:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023797.564002:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007092992 00000100:00100000:0.0:1789023797.564012:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007092992 00000100:00100000:0.0:1789023797.564073:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:0.0:1789023797.564083:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+31:14505:x1875927007092992:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789023797.564185:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+31:14505:x1875927007092992:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 104us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023797.564193:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 50 00000100:00100000:2.0:1789023797.568506:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.568908:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007093120 00000100:00100000:1.0:1789023797.568918:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007093120 00000100:00100000:1.0:1789023797.569006:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 51 00000100:00100000:1.0:1789023797.569017:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+31:14505:x1875927007093120:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789023797.625119:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+31:14505:x1875927007093120:12345-192.168.203.48@tcp:44:lhsmtool_posix.0 Request processed in 56094us (56641us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.625131:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 51 00000001:00080000:3.0:1789023797.625275:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1789023797.625287:0:5867:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789023797.625327:0:5867:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789023797.625624:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024898176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789023797.625674:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023797.625860:0:16566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024898176 00000100:00100000:1.0:1789023797.625867:0:16566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024898176 00000100:00100000:1.0:1789023797.625927:0:16566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789023797.625934:0:16566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875927024898176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789023797.626058:0:16566:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789023797.626061:0:16566:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1789023797.626064:0:16566:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789023797.626066:0:16566:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789023797 -> 1789023797 00002000:00010000:1.0:1789023797.626069:0:16566:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789023797.626106:0:16566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875927024898176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (430us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1789023797.626111:0:16566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789023797.626177:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789023797.626205:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e64c2245180/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789023797.626210:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024898176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789023797.628885:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.629373:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007093248 00000100:00100000:3.0:1789023797.629384:0:15023:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007093248 00000100:00100000:3.0:1789023797.630065:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1789023797.630078:0:15023:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:2361:x1875927007093248:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789023797.630183:0:15023:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:2361:x1875927007093248:12345-192.168.203.48@tcp:16:lhsmtool_posix.0 Request processed in 108us (1306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.630190:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:0.0:1789023797.633980:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.634057:0:14340:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007093504 00000100:00100000:3.0:1789023797.634066:0:14340:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007093504 00000100:00100000:3.0:1789023797.634153:0:14340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1789023797.634163:0:14340:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+14:14505:x1875927007093504:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789023797.634213:0:14340:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023797.634237:0:14340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66e00/0xc3c1fcbfb341927d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe39 expref: 14 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.634255:0:14340:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:3.0:1789023797.634260:0:14340:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789023797.634288:0:14340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.634300:0:14340:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.634325:0:14340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789023797.635966:0:14340:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025d647c7 reply state 00000000358bdcd5 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023797.635982:0:14340:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789023797.636096:0:14340:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+15:14505:x1875927007093504:12345-192.168.203.48@tcp:36:lhsmtool_posix.0 Request processed in 1932us (2122us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789023797.636116:0:14340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 52 00000100:00100000:3.0:1789023797.640837:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00010000:00010000:1.0:1789023797.641360:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641373:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641381:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641387:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.641392:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641400:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641415:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:1.0:1789023797.641418:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023797.641423:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641428:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713d200/0xc3c1fcbfb341928b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14340 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.641471:0:16566:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007093632 00000100:00100000:1.0:1789023797.641505:0:16566:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007093632 00000100:00100000:1.0:1789023797.641561:0:16566:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:1.0:1789023797.641570:0:16566:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:14505:x1875927007093632:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789023797.641585:0:16566:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789023797.641598:0:16566:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb1958d270a9bfe47 expref: -99 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641644:0:16566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 8 pid: 15023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641654:0:16566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023797.641659:0:16566:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023797.641665:0:16566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 8 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641696:0:16566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 8 pid: 15023 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.641711:0:16566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 8 pid: 15023 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.641725:0:16566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16566:1875927024898304:192.168.203.48@tcp:104: 00000100:00100000:1.0:1789023797.641811:0:16566:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d2b6b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023797.645116:0:16566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16566:1875927024898304:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023797.645147:0:16566:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 8 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.645167:0:16566:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e64c2f66c00, rc 0) 00000100:00100000:3.0:1789023797.645221:0:16566:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+8:14505:x1875927007093632:12345-192.168.203.48@tcp:101:lhsmtool_posix.0 Request processed in 3651us (4392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.645229:0:16566:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 16 00000100:00100000:3.0:1789023797.645938:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.648782:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007093760 00000100:00100000:3.0:1789023797.648795:0:14327:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007093760 00010000:00010000:3.0:1789023797.648840:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 8 pid: 15023 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023797.648886:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:3.0:1789023797.648906:0:14327:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65c84c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+8:2361:x1875927007093760:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023797.648921:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023797.648943:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 8 pid: 15023 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.648956:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 8 pid: 15023 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.648993:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb3419284 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe40 expref: 8 pid: 15023 timeout: 563 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.649011:0:14327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023797.649015:0:14327:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023797.649022:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 7 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.649032:0:14327:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 7 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.649072:0:14327:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 7 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023797.649084:0:14327:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14327:1875927024898432:192.168.203.48@tcp:105: 00000100:00100000:3.0:1789023797.649158:0:14327:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06c7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789023797.653975:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023797.654039:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007093888 00000100:00100000:0.0:1789023797.654049:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007093888 00000100:00100000:0.0:1789023797.654109:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:0.0:1789023797.654120:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+8:2361:x1875927007093888:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789023797.654307:0:15024:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789023797.654311:0:15024:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789023796 00002000:00010000:0.0:1789023797.654314:0:15024:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789023795 00002000:00010000:0.0:1789023797.654316:0:15024:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789023797 -> 1789023796 00002000:00010000:0.0:1789023797.654318:0:15024:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789023797.654391:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:2361:x1875927007093888:12345-192.168.203.48@tcp:2:lhsmtool_posix.0 Request processed in 272us (424us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789023797.654400:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 17 00000100:00100000:3.0:1789023797.656126:0:14327:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14327:1875927024898432:192.168.203.48@tcp:105: 00010000:00010000:3.0:1789023797.656151:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023797.656195:0:14327:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65c84c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+8:2361:x1875927007093760:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 7291us (10259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.656205:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 13 00000100:00100000:1.0:1789023797.659740:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.659904:0:15022:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007094016 00000100:00100000:3.0:1789023797.659914:0:15022:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007094016 00000100:00100000:3.0:1789023797.659973:0:15022:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:3.0:1789023797.659996:0:15022:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+8:2362:x1875927007094016:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789023797.660039:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.660059:0:15022:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 8 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.660068:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023797.660072:0:15022:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789023797.660076:0:15022:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.660108:0:15022:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 8 pid: 16566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.660121:0:15022:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 8 pid: 16566 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023797.660134:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15022:1875927024898560:192.168.203.48@tcp:104: 00000100:00100000:3.0:1789023797.660215:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65d06c7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789023797.662908:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15022:1875927024898560:192.168.203.48@tcp:104: 00010000:00010000:3.0:1789023797.662935:0:15022:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.664909:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.665117:0:16455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007094144 00000100:00100000:2.0:1789023797.665126:0:16455:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007094144 00010000:00010000:2.0:1789023797.665163:0:16455:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 9 pid: 16566 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023797.665204:0:16455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 14 00000100:00100000:2.0:1789023797.665213:0:16455:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:2362:x1875927007094144:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789023797.665227:0:16455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789023797.665248:0:16455:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 9 pid: 16566 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.665261:0:16455:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 9 pid: 16566 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.665283:0:16455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f066f60e/0xc3c1fcbfb3419292 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe47 expref: 9 pid: 16566 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.665298:0:16455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023797.665302:0:16455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789023797.665308:0:16455:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.665317:0:16455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.665366:0:16455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789023797.665424:0:16455:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+8:2362:x1875927007094144:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 211us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023797.665432:0:16455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 14 00010000:00010000:3.0:1789023797.665732:0:15022:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665749:0:15022:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665782:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665791:0:15022:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665799:0:15022:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665807:0:15022:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023797.665810:0:15022:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665820:0:15022:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665841:0:15022:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.665850:0:15022:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb3419299 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023797.665922:0:15022:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2244380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:2362:x1875927007094016:12345-192.168.203.48@tcp:1:lhsmtool_posix.0 Request processed in 5927us (6190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.665930:0:15022:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 18 00000100:00100000:1.0:1789023797.669804:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.670084:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007094400 00000100:00100000:2.0:1789023797.670095:0:14341:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007094400 00000100:00100000:2.0:1789023797.670143:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 53 00000100:00100000:2.0:1789023797.670153:0:14341:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+14:14505:x1875927007094400:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789023797.670232:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.670259:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.670270:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.670662:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.670674:0:14341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.670683:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.670713:0:14341:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 15 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.670739:0:14341:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 15 pid: 14341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023797.670753:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14341:1875927024898688:192.168.203.48@tcp:104: 00000100:00100000:2.0:1789023797.671023:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c7ec6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789023797.674773:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.674850:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007094528 00000100:00100000:3.0:1789023797.674859:0:14325:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007094528 00010000:00010000:3.0:1789023797.674904:0:14325:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 16 pid: 14341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023797.674945:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 15 00000100:00100000:3.0:1789023797.674955:0:14325:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+16:2362:x1875927007094528:12345-192.168.203.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789023797.674968:0:14325:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789023797.674974:0:14325:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 16 pid: 14341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.674987:0:14325:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 16 pid: 14341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.675008:0:14325:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:3.0:1789023797.675014:0:14325:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.675024:0:14325:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.675032:0:14325:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023797.675068:0:14325:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789023797.675113:0:14325:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+16:2362:x1875927007094528:12345-192.168.203.48@tcp:103:ldlm_bl.0 Request processed in 160us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.675121:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 15 00010000:00010000:2.0:1789023797.675247:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67c00/0xc3c1fcbfb341926f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe32 expref: 15 pid: 14341 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023797.675263:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14341:1875927024898688:192.168.203.48@tcp:104: 00010000:00010000:2.0:1789023797.675281:0:14341:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.675290:0:14341:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.675296:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789023797.675506:0:14341:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789023797.675795:0:14341:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789023797.675851:0:14341:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789023797.675939:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14341:1875927024898816:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789023797.676033:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023797.676100:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c7ec6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789023797.677830:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024898816 00000100:00100000:2.0:1789023797.677902:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024898816 00000100:00100000:2.0:1789023797.677988:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789023797.678004:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14341:x1875927024898816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789023797.678178:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14341:x1875927024898816:12345-0@lo:1000:mdt00_001.0 Request processed in 176us (2145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023797.678186:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789023797.678262:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14341:1875927024898816:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1789023797.679243:0:14341:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789023797.679322:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2246680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14341:1875927024898944:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789023797.679379:0:14341:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789023797.679465:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2d2e540 going to sleep for 11 seconds 00000100:00100000:2.0:1789023797.679545:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024898944 00000100:00100000:2.0:1789023797.679551:0:14345:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024898944 00000100:00100000:2.0:1789023797.679579:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789023797.679586:0:14345:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14341:x1875927024898944:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789023797.679741:0:14345:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14341:x1875927024898944:12345-0@lo:1000:mdt00_001.0 Request processed in 155us (361us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789023797.679749:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789023797.680007:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2246680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14341:1875927024898944:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1789023797.680040:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680050:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680058:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680064:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07e00 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.680068:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680076:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680089:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:1.0:1789023797.680092:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023797.680097:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680104:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07e00/0xc3c1fcbfb34192a7 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680133:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680140:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680145:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680159:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66200 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.680163:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680169:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680178:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023797.680181:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789023797.680187:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe16 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680198:0:14341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe16 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680207:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe16 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.680231:0:14341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e65e713cc00/0xc3c1fcbfb3419206 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.48@tcp remote: 0xb1958d270a9bfe16 expref: 18 pid: 14340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.680241:0:14341:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e64c2245f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14341:1875927024899072:192.168.203.48@tcp:105: 00000100:00100000:1.0:1789023797.680307:0:14341:0:(client.c:2716:ptlrpc_set_wait()) set ffff8e65c2fd9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789023797.683292:0:14341:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e64c2245f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14341:1875927024899072:192.168.203.48@tcp:105: 00010000:00010000:1.0:1789023797.683321:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683349:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66200/0xc3c1fcbfb34191ff lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683380:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683393:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683404:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683414:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683420:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683427:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683432:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.683436:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683444:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.683454:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023797.683468:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789023797.683472:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684673:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f67800/0xc3c1fcbfb34192ae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684689:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684695:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684701:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684707:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07800 already unused, calling callback (ffffffffc21ae4f0) 00010000:00010000:1.0:1789023797.684710:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684716:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684727:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e65eea05b00) 00010000:00010000:1.0:1789023797.684730:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789023797.684733:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.684740:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e65f6d07800/0xc3c1fcbfb34192a0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.684975:0:14341:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2247b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+18:14505:x1875927007094400:12345-192.168.203.48@tcp:57:lhsmtool_posix.0 Request processed in 14821us (15176us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789023797.684985:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 53 00000020:00080000:1.0:1789023797.684999:0:14341:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789023797.685376:0:14373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789023797.685381:0:14373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789023797.685404:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789023797.685410:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789023797.689277:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.689316:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.689376:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007094784 00000100:00100000:1.0:1789023797.689386:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007094784 00000100:00100000:1.0:1789023797.689422:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007094912 00000100:00100000:1.0:1789023797.689425:0:14343:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007094912 00000100:00100000:1.0:1789023797.689441:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 10 00000100:00100000:1.0:1789023797.689461:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65fcb61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+19:14505:x1875927007094784:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789023797.690349:0:14343:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789023797.690450:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789023797.690778:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.690795:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.690808:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.690817:0:14343:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.690823:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.690829:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.690948:0:14343:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789023797.691050:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65fcb61c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+21:14505:x1875927007094784:12345-192.168.203.48@tcp:35:lhsmtool_posix.0 Request processed in 1600us (1779us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789023797.691059:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 10 00000020:00080000:1.0:1789023797.691072:0:14343:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789023797.691117:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 11 00000100:00100000:1.0:1789023797.691127:0:14343:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+20:14504:x1875927007094912:12345-192.168.203.48@tcp:49:dd.0 00000100:00100000:1.0:1789023797.691192:0:14343:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9cbc637b-4cf6-4660-9856-c105afa27f7e+20:14504:x1875927007094912:12345-192.168.203.48@tcp:49:dd.0 Request processed in 67us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789023797.691199:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 11 00010000:00010000:0.0:1789023797.692507:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789023797.692517:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.692527:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023797.692531:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.692539:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.692554:0:14329:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e65f41d1200) 00010000:00010000:0.0:1789023797.692557:0:14329:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789023797.692562:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.692567:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e64c2f66400/0xc3c1fcbfb34192b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.692581:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023797.692583:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023797.692585:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789023797.769916:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789023797.769938:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024899200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789023797.770002:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789023797.770074:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024899200 00000100:00100000:2.0:1789023797.770081:0:15027:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024899200 00000100:00100000:2.0:1789023797.770129:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789023797.770138:0:15027:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024899200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789023797.770169:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789023797.770214:0:15027:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1875927024899200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789023797.770221:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789023797.770263:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65df3d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1875927024899200:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789023797.770406:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024899712:0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770441:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023797.770463:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789023797.770470:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024899456:0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770472:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024899584:0@lo:400:kworker.0 00000100:00100000:0.0:1789023797.770510:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023797.770531:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789023797.770536:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023797.770538:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024899328:0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770570:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024899712 00000100:00100000:3.0:1789023797.770576:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024899712 00000100:00100000:0.0:1789023797.770587:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023797.770618:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024899584 00000100:00100000:0.0:1789023797.770621:0:3313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024899840:0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770623:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024899584 00000100:00100000:3.0:1789023797.770647:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023797.770652:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789023797.770657:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023797.770677:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024899328 00000100:00100000:0.0:1789023797.770683:0:14333:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024899328 00000100:00100000:3.0:1789023797.770700:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875927024899712:12345-0@lo:400:kworker.0 Request processed in 45us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.770707:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789023797.770720:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789023797.770722:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024899840 00000100:00100000:3.0:1789023797.770726:0:14342:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024899840 00000100:00100000:0.0:1789023797.770731:0:14333:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65d00a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:3313:x1875927024899328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770747:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789023797.770755:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024899584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023797.770769:0:14333:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65d00a4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96e4333f-cc82-4def-9373-4ed84d9f7775+19:3313:x1875927024899328:12345-0@lo:400:kworker.0 Request processed in 41us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023797.770776:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789023797.770807:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875927024899584:12345-0@lo:400:kworker.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.770815:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789023797.770829:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789023797.770832:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:96e4333f-cc82-4def-9373-4ed84d9f7775:3313:1875927024899328:0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770839:0:14342:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024899840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789023797.770857:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024899456 00000100:00100000:0.0:1789023797.770861:0:15024:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024899456 00000100:00100000:3.0:1789023797.770879:0:14342:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875927024899840:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789023797.770898:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789023797.770905:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789023797.770923:0:15024:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024899456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770930:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875927024899584:0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770943:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1875927024899712:0@lo:400:kworker.0 00000100:00100000:0.0:1789023797.770962:0:15024:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875927024899456:12345-0@lo:400:kworker.0 Request processed in 48us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023797.770970:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789023797.770976:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1875927024899840:0@lo:400:kworker.0 00000100:00100000:3.0:1789023797.770991:0:3313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65c84c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1875927024899456:0@lo:400:kworker.0 00000100:00080000:2.0:1789023797.772518:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789023797.772535:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1789023797.811608:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:1.0:1789023797.811626:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:1.0:1789023797.811633:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000100:00100000:2.0:1789023797.866822:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:2.0:1789023797.866877:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023797.867045:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095040 00000100:00100000:1.0:1789023797.867055:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095040 00000100:00100000:1.0:1789023797.867120:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095168 00000100:00100000:1.0:1789023797.867124:0:15029:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095168 00000100:00100000:1.0:1789023797.867144:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:1.0:1789023797.867153:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+6:2364:x1875927007095040:12345-192.168.203.48@tcp:4:dd.0 00002000:00010000:1.0:1789023797.867200:0:15029:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa25634, atime: 0x6aa25633, ctime: 0x6aa25634, blocks: 0x1 00010000:00010000:1.0:1789023797.867210:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.867226:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=463s v=(0 0) 00010000:00010000:1.0:1789023797.867230:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023797.867236:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.867256:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.871831:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023797.872215:0:15028:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789023797.872225:0:15028:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789023797.872581:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095296 00000100:00100000:3.0:1789023797.872591:0:15028:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095296 00000100:00100000:2.0:1789023797.873154:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 1 00000100:00100000:2.0:1789023797.873166:0:16571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65df3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+8:2363:x1875927007095168:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:2.0:1789023797.873200:0:16571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.873217:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023797.873222:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023797.873228:0:16571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.873242:0:16571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789023797.934690:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1789023797.934970:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789023797.934975:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789023796 -> 1789023797 00002000:00010000:2.0:1789023797.934979:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1789023797.934993:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935006:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935015:0:15029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935042:0:15029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f67800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:2.0:1789023797.935047:0:15029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935057:0:15029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935081:0:15029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935089:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000144ebeca/0xc3c1fcbfb34192bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789023797.935204:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+10:2364:x1875927007095040:12345-192.168.203.48@tcp:4:dd.0 Request processed in 68047us (68386us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789023797.935215:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 0 00000100:00100000:2.0:1789023797.935250:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:2.0:1789023797.935261:0:15029:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e64c2245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:2364:x1875927007095296:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:2.0:1789023797.935291:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935303:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789023797.935317:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789023797.935324:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789023797.935357:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023797.961661:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789023797.982293:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:1.0:1789023797.984697:0:16571:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1789023797.984706:0:16571:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:1.0:1789023797.984721:0:16571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.984742:0:16571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.984750:0:16571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.984782:0:16571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023797.984791:0:16571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.984800:0:16571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.984825:0:16571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023797.984833:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e38ea1b5/0xc3c1fcbfb34192c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023797.984951:0:16571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65df3d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:2363:x1875927007095168:12345-192.168.203.48@tcp:4:dd.0 Request processed in 111784us (118070us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789023797.984966:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 1 00000001:00080000:1.0:1789023798.022779:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00010000:00010000:3.0:1789023798.023283:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.023298:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.023308:0:15029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.023335:0:15029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65f6d07e00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023798.023340:0:15029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.023349:0:15029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.023369:0:15029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.023378:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b26d5d51/0xc3c1fcbfb34192ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023798.023590:0:15029:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e64c2245f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2364:x1875927007095296:12345-192.168.203.48@tcp:4:dd.0 Request processed in 88328us (151763us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789023798.023600:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 2 00000100:00100000:0.0:1789023798.030141:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023798.030254:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095424 00000100:00100000:1.0:1789023798.030264:0:15030:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095424 00000100:00100000:1.0:1789023798.030333:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:1.0:1789023798.030344:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+5:2361:x1875927007095424:12345-192.168.203.48@tcp:4:dd.0 00002000:00010000:1.0:1789023798.030395:0:15030:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aa25635, atime: 0x6aa25633, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1789023798.030403:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.030419:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:1.0:1789023798.030423:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789023798.030429:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.030442:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023798.038545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023798.038668:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095552 00000100:00100000:3.0:1789023798.038688:0:16571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095552 00000100:00100000:0.0:1789023798.038749:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:0.0:1789023798.038907:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:3.0:1789023798.045115:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095680 00000100:00100000:3.0:1789023798.045147:0:16571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095680 00000100:00100000:3.0:1789023798.045243:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095808 00000100:00100000:3.0:1789023798.045247:0:16571:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095808 00000100:00100000:3.0:1789023798.045284:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789023798.045307:0:16571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:2362:x1875927007095552:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:3.0:1789023798.045365:0:16571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.045408:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023798.045413:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023798.045421:0:16571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.045439:0:16571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023798.045727:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.48@tcp (source: 12345-192.168.203.48@tcp) 00000100:00100000:1.0:1789023798.047640:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927007095936 00000100:00100000:1.0:1789023798.047654:0:15028:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927007095936 00000001:00080000:1.0:1789023798.116126:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:3.0:1789023798.121747:0:15030:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1789023798.121760:0:15030:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789023797 00002000:00010000:3.0:1789023798.121764:0:15030:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 10247 00010000:00010000:3.0:1789023798.121784:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.121800:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.121810:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.121819:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e64c2f66200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023798.121825:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.121836:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.121883:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.122999:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fe34c28/0xc3c1fcbfb34192d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023798.123150:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+12:2361:x1875927007095424:12345-192.168.203.48@tcp:4:dd.0 Request processed in 92802us (93010us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789023798.123162:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 3 00000100:00100000:3.0:1789023798.123207:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:3.0:1789023798.123221:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+11:2361:x1875927007095680:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:3.0:1789023798.123265:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.123282:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023798.123287:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023798.123294:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.123311:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789023798.178728:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:3.0:1789023798.178766:0:16571:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 6291456 00010000:00010000:3.0:1789023798.178782:0:16571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.178809:0:16571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.178815:0:16571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.178820:0:16571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713c400 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:3.0:1789023798.178824:0:16571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.178830:0:16571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.178846:0:16571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.178851:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090300ae0/0xc3c1fcbfb34192d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789023798.178954:0:16571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+11:2362:x1875927007095552:12345-192.168.203.48@tcp:4:dd.0 Request processed in 133656us (140417us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789023798.178965:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 4 00000100:00100000:3.0:1789023798.178998:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 6 00000100:00100000:3.0:1789023798.179011:0:16571:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+10:2362:x1875927007095808:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:3.0:1789023798.179042:0:16571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.179065:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023798.179070:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789023798.179085:0:16571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789023798.179099:0:16571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789023798.234934:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:0.0:1789023798.236335:0:15030:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00002000:00010000:0.0:1789023798.236354:0:15030:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:0.0:1789023798.236368:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236381:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236389:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236395:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d800 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023798.236411:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236419:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236438:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236545:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d23ed256/0xc3c1fcbfb34192df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023798.236624:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+10:2361:x1875927007095680:12345-192.168.203.48@tcp:4:dd.0 Request processed in 113404us (197871us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789023798.236638:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 5 00000100:00100000:0.0:1789023798.236668:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.48@tcp, seq: 7 00000100:00100000:0.0:1789023798.236685:0:15030:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:2361:x1875927007095936:12345-192.168.203.48@tcp:4:dd.0 00010000:00010000:0.0:1789023798.236715:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236727:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023798.236732:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789023798.236739:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.236762:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789023798.268789:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1789023798.268880:0:16571:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:1.0:1789023798.268894:0:16571:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1789023798.268921:0:16571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.268934:0:16571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.268943:0:16571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.268950:0:16571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65e713d200 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:1.0:1789023798.268955:0:16571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.268964:0:16571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.268984:0:16571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789023798.268992:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc9ab881/0xc3c1fcbfb34192e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789023798.269080:0:16571:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:9cbc637b-4cf6-4660-9856-c105afa27f7e+9:2362:x1875927007095808:12345-192.168.203.48@tcp:4:dd.0 Request processed in 90069us (230168us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789023798.269089:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 6 00002000:00010000:0.0:1789023798.294902:0:15030:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1789023798.294922:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.294934:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.294944:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.294952:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e65c8d04a00 already unused, calling callback (ffffffffc17718b0) 00010000:00010000:0.0:1789023798.294958:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.294967:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.294997:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789023798.295006:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007152309b/0xc3c1fcbfb34192ed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789023798.295095:0:15030:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e70b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9cbc637b-4cf6-4660-9856-c105afa27f7e+7:2361:x1875927007095936:12345-192.168.203.48@tcp:4:dd.0 Request processed in 58408us (249371us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789023798.295105:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.48@tcp, seq: 7 00000001:00080000:1.0:1789023798.295841:0:7659:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1789023798.987297:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789023799.707344:0:16608:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1789023799.818787:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789023799.818808:0:3312:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8e65e76fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024899968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789023799.818868:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789023799.818967:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875927024899968 00000100:00100000:0.0:1789023799.818974:0:15026:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875927024899968 00000100:00100000:0.0:1789023799.819036:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789023799.819046:0:15026:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8e65e76fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024899968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789023799.819077:0:15026:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789023799.819120:0:15026:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8e65e76fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875927024899968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789023799.819126:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789023799.819167:0:3312:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8e65e76fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1875927024899968:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789023799.819765:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789023800.010082:0:14328:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789023801.034159:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 28871 lines, 28871 kept, 0 dropped, 0 bad.